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I.  IMTRODUCTION 


A.  PURPOSE  OF  THESIS 

The  purpose  of  this  thesis  is  to  evaluate  the  effects  of 
Command,  Control,  Communications,  Computers  and  Intelligence 
(C*I)  on  Carrier  Battle  Group  (CVBG)  operations.  During  the 
last  few  years  a  great  deal  of  emphasis  has  been  placed  on 
improving  the  military's  C*I  capability.  The  Global  Command 
and  Control  System  (GCCS),  Copernicus  and  C*I  for  the  Warrior 
are  all  initiatives  designed  to  increase  the  military's 
ability  to  transfer,  process  and  utilize  the  vast  amounts  of 
strategic  and  tactical  data  gathered  during  the  planning  and 
execution  of  military  operations.  As  resources  for  the  design 
and  procurement  of  military  forces  decline,  the  importance  of 
achieving  the  "most  bang  for  the  buck"  becomes  critical.  An 
effective  C*I  system  gives  the  commander  the  ability  to  tailor 
his  forces  and  deliver  the  maximum  striking  power  available 
while  minimizing  the  threat  to  his  own  forces. 

B.  RESEARCH  QUESTIONS 

•  What  is  the  effective  improvement  or  degradation,  if  any, 
to  the  striking  capability  of  the  battle  group  if  c'l  is 
improved? 

•  What  is  the  effective  improvement  or  degradation  to  the 
defensive  capability  of  the  battle  group  if  c*l  is 
improved? 
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•  How  effective  is  C*I  as  a  Battle  Group  Force  Multiplier  in 

a  Littoral  Environment? 

C.  METHODOLOGY 

The  Research  Evaluation  System  Analysis  (RESA)  wargame  was 
utilized  to  conduct  qualitative  and  quantitative  analyses  on 
the  impact  of  Command,  Control  and  Intelligence  on  the  ability 
of  a  CVBG  to  conduct  offensive  air  strike  operations  while 
maintaining  an  effective  defensive  posture.  Players 
participated  in  a  tactical  decision-making  process  during  a 
simulated  potential  conflict  involving  North  Korea.  Each 
scenario  required  the  player  to  command  both  air  and  surface 
naval  forces  during  an  air-strike  mission  conducted  on  a  North 
Korean  nuclear  power  facility.  Additionally,  an  appropriate 
defensive  posture  was  required  to  protect  the  CVBG  against 
North  Korean  retaliation.  Communications  and  Computers  were 
not  addressed  due  to  the  inability  to  effectively  incorporate 
changes  in  these  parameters  in  the  RESA  wargame.  Command  and 
Control  data  were  gathered  from  interviews  with  wargame 
participants  concerning  their  actions  during  simulation  play. 
These  interviews  provided  the  basis  for  the  qualitative 
assessment  as  well  as  some  of  the  quantitative  information. 

Intelligence  information  was  provided  to  the  participants 
prior  to  and  during  their  simulation  run.  This  information 
was  utilized  to  formulate  an  offensive  and  defensive  strategy, 
as  well  as  provide  updates  about  enemy  forces  and  intentions 
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throughout  the  wargane.  Variations  in  the  resolution  of 
intelligence  inforaation  permitted  observation  of  their 
effects  on  planning  and  execution  of  military  operations. 
Data  collected  in  this  area  primarily  consisted  of  aircraft 
attritions  and  the  amount  of  ordnance  placed  on  target.  The 
simulations  provided  a  controlled  environment  as  well  as  the 
quantitative  data  necessary  for  an  in-depth  analysis. 

D.  SCOPE 

This  thesis  focuses  on  CVBG  operations  in  a  littoral 
environment.  The  primary  emphasis  is  centered  around  strike 
planning  and  execution  as  well  as  maintaining  an  effective 
anti-air  warfare  (AAW)  posture.  In  addition,  anti-surface 
warfare  (ASUW)  played  an  important  role;  however,  anti¬ 
submarine  warfare  (ASW)  was  not  considered. 
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II.  BACKGROOMD  AMD  HISTORY 


A.  RELEVANCE  OF  C*I  TO  NARFIGHTIMG 

Conunand  is  a  function  that  arranges  and  coordinates 
everything  that  an  organization  or  military  force  needs  to 
perfoim  its  assigned  mission.  (Van  Creveld,  1985,  p6)  Command 
responsibilities  are  directly  proportional  to  the  force's 
complexity  and  sophistication.  The  three  major  elements  of  a 
command  system  are  organizations,  procedures  and  technical 
means.  (Van  Creveld,  1985,  plO)  Control  is  the  means  by 
which  command  functions  are  executed.  It  is  the  application, 
managing  and  administration  of  the  command  elements  in  a 
coordinated  effort  to  accomplish  a  mission.  Although  it  is 
possible  to  have  command  without  control,  the  converse  is  not 
necessarily  true.  Effective  management  and  leadership 
requires  the  integration  of  command  and  control.  Command  and 
control  is  thus  a  complex  process  of  data  collection,  analysis 
and  decision  making  skills  utilized  by  an  individual  or  group 
of  people  when  a  decision  must  be  made  and  executed. 

Communications  consist  of  the  method  of  data  transfer 
between  different  groups.  This  can  be  something  as  simple  as 
a  verbal  exchange  or  can  be  as  complex  as  an  intricate 
satellite  communications  network.  Communications  incorporate 
the  flow  of  information  necessary  to  accomplish  a  task. 
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Computers  have  greatly  increased  the  amount  of  data  that 
can  be  collected  and  processed.  Additionally,  computers  play 
an  important  role  in  the  transfer  of  data  and  thus  have  a 
significant  impact  on  communication  systems.  In  fact,  the 
importance  of  computers  is  felt  throughout  the  entire  C*I 
spectrum. 

Intelligence  information  has  always  played  a  key  role  in 
determining  an  adversary's  intention.  Intelligence  is  the 
total  collection  of  information  relevant  to  effective  combat 
system  employment  during  the  on-going,  evolving  or  ultimately 
planned  operation  or  as  otherwise  used  in  the  fulfillment  of 
command/mission  objective.  (Alphatech,  1994,  pi) 

1 .  Historical  Framework 

The  parameters  affecting  C*I  are  the  same  today  as 
they  were  centuries  ago.  Commanders  have  always  sought  to 
gain  as  much  intelligence  about  their  adversary's  intention  as 
possible.  Spies  and  diplomats  have  always  been  a  valuable 
source  of  information  and  have  been  utilized  successfully 
throughout  history.  Prior  to  1800  the  additional  sources  of 
intelligence  available  included  books  and  maps  from  which  a 
commander  could  sift  information  concerning  the  intended 
theater  of  operations,  terrain  features,  climate,  enemy 
composition  and  disposition.  (Van  Creveld,  1985,  pl9) 

Communication  functions  had  a  major  influence*  on  the 
commander's  ability  to  control  his  force(s).  Perhaps  the  most 
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important  factor  was  the  amount  of  time  required  to  pass 
information  from  sender  to  receiver  through  a  human  courier. 
The  time  required  was  a  function  of  distance  and  thus  the 
greater  the  distance  the  less  up-to-date  the  information  was. 
The  telegraph  was  the  first  substantial  advance  in 
communications;  however,  dependent  upon  wires  and  fixed 
transmitting/relaying  stations,  their  usefulness  was  more 
suited  to  defensive  roles  and  strategic,  administrative  and 
logistic  communications.  (Van  Creveld,  1985,  pl07)  However, 
due  to  the  telegraph's  vulnerability  and  unreliability, 
tactical  communication  was  transmitted  via  couriers  in  the 
traditional  way.  (Van  Creveld,  1985,  plO) 

Computing  systems  were  comprised  of  human  tabulators 
responsible  for  compiling,  analyzing  and  reporting  on  the 
information  obtained.  Napoleon  created  the  Statistical  Bureau 
which  obtained  long-range  strategic  enemy  intelligence, 
analyzed  the  data  and  reported  the  results  to  military  planner 
(Van  Creveld,  1985,  p66)  Although  these  "human  computers" 
performed  a  vital  function,  they  were  limited  in  the  amount  of 
data  they  could  analyze  and  were  prone  to  errors. 

Command  and  control  functions  were  greatly  influenced 
by  the  sophistication  of  intelligence,  communications  and 
"computing  capabilities."  The  ability  to  effectively  control 
a  military  force  restricted  its  size  and  disposition. 
Logistics  rather  than  strategy  often  forced  commanders  to 
divide  their  forces  into  smaller,  more  manageable  units. 
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Terrain  and  supporting  infrastructures  often  placed  limits  on 
the  amount  of  men  and  equipment  that  a  given  area  could 
support  (Van  Creveld,  1985,  p25)  As  late  as  the  eighteenth 
century  no  European  army  had  a  permanent  formation  larger  than 
2,250  men.  (Van  Creveld,  1985,  p24) 

The  ancient  Romans  recognized  this  "command  and 
control"  predicament  and  devised  the  legion  as  a  means  to 
solve  the  problem.  The  legion  %fas  an  administrative  unit,  not 
a  tactical  one;  subordinate  units  carried  out  tactical 
movements  because  they  were  better  able  to  control  the  forces 
under  their  command.  (Van  creveld,  1985,  p46)  Centuries 
later,  this  concept  was  applied  by  Napoleon  as  he  divided  his 
army  into  smaller,  more  manageable,  and  thus  more  effective, 
divisions  and  corps.  (Van  Creveld,  1985,  p72) 

2.  Present 

Modern  day  intelligence  collection  methods  incorporate 
a  wide  variety  of  techniques.  Although  diplomats  and  spies 
still  provide  valuable  information,  complex  electronic  devices 
have  made  it  possible  to  exploit  the  electromagnetic  spectrum 
to  gather  imagery,  communication  and  signal  data  about  an 
adversary. 

Communication  methods  have  also  evolved  dramatically. 
Once  dependent  upon  the  courier  for  reliable  information 
transfer,  new  methods  such  as  radio  frequency  (RF),  microwave, 
fiber  optics  and  satellite  communications  have  made  it 
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possible  to  send  vast  amounts  of  information  in  a  fraction  of 
the  time.  Commanders  at  all  levels  can  communicate  with  other 
members  virtually  at  will. 

Computer  technology  has  advanced  so  rapidly  that  it  is 
possible  to  process  and  analyze  such  a  large  amount  of  data 
that  information  overload  becomes  a  serious  concern.  Errors 
are  almost  non-existent  and  there  is  virtually  no  limit  to  the 
amount  of  information  that  can  be  processed. 

The  command  and  control  issues  facing  the  commander 
today  are  much  more  complex  than  they  were  historically. 
There  are  now  more  types  of  intelligence  gathering  devices  and 
more  communication  methods  available  that  the  commander  must 
effectively  manage  and  utilize.  Each  new  generation  of 
equipment  and  technology  tends  to  be  more  complex  than  the  one 
it  replaced,  and  consequently  the  logistic,  administrative  and 
operating  requirements  become  more  complicated.  (Van  Creveld, 
1985,  p234)  Specialization  has  become  more  common  and  is  an 
accepted  way  to  ensure  that  new  technologies  are  adequately 
managed.  Centralization  of  command  and  control  fxinctions  is 
also  sometimes  applied  in  an  attempt  to  ensure  effective 
control  of  military  forces. 

3 .  Future 

Future  command  and  control  systems  will  undoubtably  be 
even  more  sophisticated  as  they  will  surely  have  to  be  able  to 
manage  an  ever  increasing  array  of  intelligence  gathering 
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devices/  communication  networks  and  computer  systems.  Data 
fusion  techniques  are  currently  being  developed  to  provide  the 
commander  with  the  ability  to  access  intelligence  data  bases 
through  various  types  of  communication  systems.  The  C*l  for 
the  Warrior  initiative  is  designed  to  provide  a  fused  real 
time,  true  representation  of  the  warrior's  battlespace.  (C*l 
FTW,  1993,  p4)  The  Copernicus  system  is  designed  to  provide 
the  user  with  the  ability  to  input  data  (push)  into  the  system 
and  retrieve  (pull)  information  from  the  system  relevant  to 
his  situation.  This  architecture  utilizes  a  large  data  base 
of  information  that  is  available  to  a  multitude  of  users.  The 
information  available  for  (pulling)  is  subject  to  security 
procedures,  thus  controlling  information  within  established 
security  requirements. 

Artificial  intelligence  development,  multilevel 
security  systems  and  data  compression  and  transmission 
techniques  all  will  have  an  impact  on  future  C*I  systems.  The 
successful  integration  of  intelligence  collection, 
communication  devices  and  computing  systems  into  an 
architecture  that  will  allow  a  commander  to  effectively 
command  and  control  his  force  will  certainly  be  a  challenge. 

B.  OBTERMIlflliG  C*I  REQDIRBIEIITS 

Determining  C*I  requirements  is  accomplished  by  assessing 
the  current  and  desired  warfighting  capabilities  of  the 
military  force.  Deficiencies  are  noted  and  various 
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alternative  solutions  are  identified  for  consideration.  A 
qualitative  and  quantitative  appraisal  is  perfomed  on 
alternative  solutions  so  that  the  best  solution  may  be 
identified  to  correct  the  deficiency. 

1 .  liarfighting  Assessment 

Assessing  the  warfighting  capabilities  and  requisites 
of  a  military  force  requires  a  thorough  examination  of  the 
intended  areas  of  operation.  The  area(s)  of  intended 
operation  greatly  influence  C*I  system  development  and 
implementation.  Once  identified,  C*I  system  requirements  can 
be  recognised  and  procured  within  existing  constraints, 
a.  Scenarios  of  Intended  Operations 

The  geographic  location  in  which  a  military 
organization  is  intended  to  operate  and  the  mission  it  is 
assigned  to  perform  has  a  significant  effect  on  how  the  force 
is  composed  and  supported.  For  example,  a  CVBG  conducting 
strike  operations  against  land  targets  while  maintaining  an 
effective  defense  against  retaliatory  air  strikes  has 
different  concerns  than  an  ASW  task  force  assigned  to  patrol 
and  track  all  unknown  submarine  contacts.  The  C*I  system  that 
supports  the  organization  must  enable  the  task  force  to 
perform  its  mission  to  the  utmost  of  its  ability  so  that  it 
can  maximize  its  offensive  and  defensive  potential. 

Historically,  naval  forces  were  required  to  ensure 
that  the  "Sea  Lanes  of  Communication"  were  free  of  obstruction 
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so  that  United  States  and  allied  forces  could  "project  their 
power"  anywhere  in  the  world.  Typically,  this  strategy  was 
centered  around  the  desire  to  contain  Soviet  and  communist 
expansion  on  a  global  scale.  With  the  collapse  of  the  Soviet 
Union  and  the  fall  of  communist  regimes  in  eastern  Europe, 
U.S.  national  strategy  has  shifted  from  a  focus  on  a  global 
threat  to  a  focus  on  regional  challenges.  (From  the  Sea,  1992, 
pi)  Although  the  focus  has  been  redefined,  American  forces 
will  still  be  called  upon  to  accomplish  traditional  missions 
of  strategic  deterrence,  control  of  the  seas,  extended  and 
continuous  on-scene  crisis  response,  power  projection  and 
large  scale  sealift.  (From  the  Sea,  1992,  pi) 

Littoral  environment  campaigns  appear  to  encompass 
the  majority  of  future  military  operations.  Whether  the 
mission  is  support  for  a  hummnitarian  relief  effort  off  the 
coast  of  Somalia,  counter-narcotic  operations  in  the  Caribbean 
Sea  or  extensive  strike  operations  conducted  in  support  of  a 
"Desert  Storm"  style  conflict,  U.S.  naval  forces  will  be 
operating  in  a  littoral  environment.  Consequently,  c*I 
systems  must  be  optimized  for  these  types  of  operations, 
b.  Constraints 

Unfortunately  there  are  many  constraints  that 
hinder  the  development,  procurement  and  installation  of 
effective  C*I  systems.  Some  of  these  constraints  include 
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technology,  funding,  force  levels  and  coaposition,  time  and 
national  military  strategies. 


Technological  constraints  include  the  limitations 
of  current  systems.  Communication  networks  and  computer 
systems  are  limited  by  weight  and  the  capacity  of  information 
they  can  handle,  intelligence  gathering  methods  are  limited 
by  the  resolution  of  sensors  and  amount  of  information  that 
can  effectively  be  collected. 

Fiscal  constraints  perhaps  have  the  most 
significant  effect  on  C*I  systems.  Although  a  system  may  meet 
the  need  of  a  military  force,  the  cost  of  the  system  may 
preclude  its  procurement.  Another  factor  is  that  military 
effectiveness  is  often  measured  in  easily  quantifiable  terms. 
Attrition  rates,  amount  of  ordnance  placed  on  target  and 
delivery  rates  all  provide  excellent  ways  to  compare  systems; 
however,  C*I  systems  are  not  easily  quantifiable  and  thus  can 
suffer  from  funding  cuts  unless  they  can  clearly  demonstrate 
their  usefulness. 

The  large  variety  of  military  forces  and  their 
composition  affect  the  design  and  usage  of  C*I  systems.  A 
system  must  be  interoperable.  Every  unit  within  the  entire 
force  must  be  integrated  into  the  system  and  be  able  to 
effectively  utilize  the  system.  The  diversity,  complexity  and 
specialization  of  military  units  create  additional  problems 
for  successful  implementation  of  C*I  systems. 
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Time  imposes  additional  constraints  because  in 
many  situations  C*I  systems  must  be  deployed  as  soon  as 
possible,  and  adequate  development  lead  time  may  not  be 
available.  This  sometimes  leads  to  a  "quick  fix"  solution, 
and  subsequently  a  more  capable  system  is  never  developed. 

As  national  military  strategies  are  redefined  in 
response  to  the  changing  global  environment,  C*I  systems  must 
adapt  to  accommodate  the  changing  demands.  This  constraint 
often  requires  systems  to  be  specialized  enough  to  comply 
with  current  strategy  demands,  yet  general  enough  to  adjust  to 
evolving  strategies. 

2.  Qualitative  ^praisal 

Qualitative  appraisals  permit  the  evaluator  to  assess 
a  system  and  determine  the  benefits  and  limitations  in  a 
subjective  manner.  Although  this  type  of  survey  does  not 
generally  incorporate  an  objective  analysis,  it  provides  a 
method  to  evaluate  a  system, 
a.  Benefits 

Analyses  of  this  nature  have  the  benefit  of  not 
being  dependent  upon  a  statistical  analysis.  The  evaluation 
often  considers  numerous  intangible  features  that  may  not  be 
quantifiable.  In  many  instances  where  human  interaction  is 
involved,  this  type  of  appraisal  is  required  to  some  degree. 
It  is  very  difficult,  if  not  impossible,  to  quantify  all 
important  human  decision-making  characteristics. 
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b.  Limitations 


The  limitations  of  the  qualitative  evaluation 
include  excessive  reliance  on  human  judgment  in  the  absence  of 
sound  statistical  observations.  A  quantitative,  statistical 
analysis  precisely  measures  the  correlations  and  differences 
between  important  variables,  highlights  observed  trends  and 
provides  a  solid  anchor  for  decisions  to  be  made. 

3 .  Quantitative  Appraisal 

Quantitative  appraisals  permit  the  evaluator  to  assess 
a  system  and  determine  the  benefits  and  limitations  in  an 
objective  manner.  This  type  of  survey  generally  incorporates 
a  statistical  analysis.  It  provides  a  method  to  evaluate  a 
system  without  introducing  h\man  biases  which  could  taint  the 
analysis  and  undermine  effective  decision  making, 
a.  Kodeling 

Quantitative  analyses  often  rely  on  models  as  the 
primary  mechanism  for  conducting  the  analysis.  A  model  is  a 
simplified  representation  of  the  entity  it  imitates  or 
simulates.  (Hughes,  1984,  pi)  Analytic  models  are  typically 
either  simulations  or  wargames.  Both  may  utilize  computer 
resources  to  expedite  data  collection  and  analysis.  The 
primary  difference  between  simulations  and  wargames  is  that 
simulations  are  generally  systemic.  Human  decision  making  is 
represented  by  preprogrammed  algorithms  which  may  be  defined 
probabilistically.  (Hughes,  1984,  p42)  Parameters  are  set 


14 


before  the  simulation  begins  or  the  simulation  may  be  stopped 
to  accept  human  inputs.  This  type  of  model  has  the  benefit  of 
ensuring  that  human  biases  and  judgements  are  not  introduced 
into  the  model;  therefore,  the  results  are  a  true  reflection 
of  the  variables  and  their  interactions  in  the  model. 

Wargames,  on  the  other  hand,  incorporate  human 
interactions  into  the  model.  Human  participants  are  an 
integral  part  of  the  wargame  model,  and  the  variances  they 
introduce  are  considered  crucial  and  an  important  element  in 
the  model.  Since  the  goal  of  this  thesis  is  to  evaluate  the 
effects  of  Command,  Control  and  Intelligence,  the  most 
appropriate  model  is  the  wargame  because  it  incorporates  the 
human  factor. 

Models  can  be  classified  as  either  high  resolution 
or  low  resolution.  In  a  high  resolution  model,  a  detailed 
view  is  achieved  by  representing  individual  combatants  as 
separate  entities.  (Hartman,  1992,  pi)  A  low  resolution 
model,  on  the  other  hand,  combines  units  of  smaller  size  into 
a  larger,  more  managable  entity;  however,  this  aggregation 
sacrifices  model  detail.  For  example,  in  a  high  resolution 
model  the  total  remaining  ordnance  load  of  an  aircraft  strike 
group  may  be  tracked  by  individual  aircraft;  however,  in  the 
aggregated  (low  resolution)  model  this  may  be  tracked  by  an 
average  amount  of  ordnance  remaining  in  the  entire  formation. 
The  model  would  not  care  that  some  aircraft  were  nearly  out  of 
ordnance  while  others  may  have  a  full  load.  (Hartman,  1992, 
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p3)  Aggregated  models  also  do  not  track  information 
concerning  event  sequencing  because  they  do  not  keep  a  record 
of  individual  actions.  (Hartman,  1992,  p3) 
b.  Modol  Determination 

The  two  wargames  that  were  available  for  use  at 
the  Naval  PostGraduate  School  were  the  Joint  Theater  Level 
Simulations  (JTLS)  and  the  Research  Evaluation  Systems 
Analysis  (RESA).  Both  simulations  support  human  players; 
however,  there  are  substantial  differences  between  the  two. 

(1)  Joint  Theater  Level  Simulation  (JTLS).  JTLS 
is  a  stochastic,  real  time  player  interactive  simulation  of 
joint  theater  combat.  (Hartman,  1992,  p6)  Since  the  basic 
unit  in  JTLS  is  a  division  or  naval  task  force,  it  is  an 
aggregated,  low  resolution  model.  The  JTLS  simulation 
requires  a  great  deal  of  operator  familiarity,  and  effective 
utilization  requires  numerous  players.  The  requirement  for 
more  players  and  the  time  required  to  effectively  train  the 
players  put  unacceptable  constraints  on  the  usage  of  this 
model.  Another  important  factor  was  the  additional  variances 
induced  by  having  numerous  teams  of  players .  For  these 
reasons,  JTLS  was  not  chosen  as  the  model  for  this  thesis. 

(2J  Research  Evaluation  System  Analysis  (RESA). 

RESA  is  a  computer-based  simulation  of  the 
naval  warfare  environment  that  focuses  on  the  command  and 
control  issues  of  a  naval  battle  group.  RESA  is  not 
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distinctly  a  low  or  high  resolution  simulation.  it  can 
support  simulations  from  the  theater  level  do%m  to  the  single 
platform  level  with  equal  ability.  The  system  is  designed  for 
human  interactive  decision  making  but  also  supports  the 
ability  to  script  forces  for  consistent  actions  in  simulation 
replays.  RESA  was  selected  due  to  these  features  and  the 
relative  ease  with  which  operators  become  familiar  with  system 
commands . 


III.  EXPERIMENTAL  PLAN 


A.  INTRODUCTION 

This  experiment  utilized  24  subjects  from  the  Naval 
Postgraduate  School  (Appendix  A).  The  subjects  were  chosen 
from  both  the  staff  and  student  population  to  obtain  an 
adequate  sample  size.  Each  player  participated  in  a  wargame  in 
which  they  were  to  act  as  the  tactical  commander  and  perform 
in  a  decision-making  role  during  a  specific  scenario.  Each 
simulation  required  only  one  person  to  play  at  a  tine  to 
remove  any  variance  of  different  groups  in  the  decision-making 
process.  Each  simulation  contained  a  particular  level  of 
infoxrmation;  however,  the  player  was  not  aware  of  this  until 
after  conqpletion  of  the  run.  Data  were  collected  for  each  run 
for  later  quantitative  analysis. 

B.  PURPOSE 

1.  Real  World  Problem 

Modern  warfare  has  evolved  to  a  level  in  which  the 
control  of  information  has  become  the  vital  link  to  mission 
accomplishment.  This  type  of  warfare  has  been  termed 
"Information  Warfare",  and  has  elevated  the  importance  of  the 
command  and  control  systems  in  use  today  as  well  as  those 
planned  for  the  future.  A  commander's  information  system  is 
now  thought  of  as  a  weapons  system  used  by  the  commander  and 
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his  staff  instead  of  only  a  communications  device.  Technology 
is  advancing  at  such  a  rapid  rate  that  the  commander  and  his 
staff  require  a  system  which  meets  various  information 
requirements . 

During  the  post  Cold  War  era,  a  declining  defense 
budget  has  forced  complicated  decisions  concerning  which 
systems  the  military  will  be  allowed  to  procure.  Command  and 
control  systems  are  more  difficult  to  justify  based  on  their 
function  of  bringing  information  to  the  commander.  The  problem 
is  to  determine  the  value  of  that  information  compared  to  the 
value  of  another  weapons  system.  The  concept  of  value  is 
difficult  to  quantify  for  command  and  control  systems  using 
classical  measures  of  effectiveness. 

A  wargame  is  one  method  to  test  the  effectiveness  of 
a  particular  factor  based  on  the  ability  to  run  several 
replications  of  one  scenario.  The  simulation  can  be  totally 
automated,  or  it  can  involve  human  players.  The  latter  type  of 
wargame  is  also  used  in  a  training  environment  to  sharpen 
skills  prior  to  actual  use  in  the  real  world  environment. 

2 .  (X>  jectives 

The  primary  objective  of  the  experiment  is  to 
determine  whether  various  levels  of  information  affected 
overall  results  both  offensively  and  defensively  in  a  wargame 
simulation.  In  addition,  the  difference  in  performance  of 
individuals  from  different  warfare  specialties  was  measured. 
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3.  A|V»roach 

Subjects  participated  one  at  a  time  in  a  wargame  in 
which  they  acted  in  a  tactical  decision  making  role  on  the 
side  of  the  Blue  Forces  in  a  Naval  Battlegroup  scenario.  The 
opposing  force  consisted  of  computer  scripted  files  which  were 
run  in  reaction  to  the  Blue  Force's  actions.  This  procedure 
assumed  the  same  opposition  for  a  given  size  Blue  Force 
maneuver.  Performance  data  were  collected  in  the  form  of 
readouts  of  the  results  of  every  shot  taken  during  the  course 
of  the  simulation.  For  this  experiment,  performance  is  defined 
as  nvimbers  of  aircraft,  such  as  the  number  of  Blue  aircraft, 
reaching  the  target  and  releasing  ordnance  (offensive). 
Defensive  performance  was  measured  by  the  number  of  Orange 
attack  aircraft  able  to  launch  weapons  at  the  CVBG.  These  data 
were  then  translated  into  a  raw  data  table  (Appendix  B).  The 
raw  data  table  was  then  reduced  to  an  analysis  table  for 
further  quantitative  analysis  (Appendix  C) .  The  computer  based 
statistical  package  personal  computer  version  of  Ninitab  was 
used  as  the  prime  analysis  tool. 

The  two  factors  of  primary  concern  were  levels  of 
information  and  tactical  experience  level.  Information  was 
divided  into  four  different  levels  (very  low,  low,  medium,  and 
high).  The  two  levels  of  tactical  experience  were  Tactical 
Air  and  Non  Tactical  Air.  Aircraft  carrier  fixed  wing  pilots 
and  Naval  Flight  Officers  were  grouped  in  the  Tactical  Air 
level  and  all  other  subjects  were  grouped  as  Non  Tactical  Air 
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(Appendix  D).  The  statistical  outputs  were  analyzed  to 
determine  criteria  for  accepting  or  rejecting  stated 
hypothesis  to  help  in  answering  the  guestions  posed  by  the 
experiment . 

4 .  Anticipated  Results 

Offensive  and  defensive  performance  should  increase 
within  each  community  with  each  incremental  increase  in 
information  level .  Individuals  from  the  Tactical  Air  community 
are  expected  to  perform  somewhat  better  than  the  Non  Tactical 
Air  Individuals  since  they  most  likely  have  been  exposed  to 
more  situations  in  which  they  made  the  types  of  decisions 
reguired  in  this  type  of  wargame. 

C.  SCOPE  OF  THE  EXPERIMEIIT 

The  Naval  Postgraduate  School  Warlab  facilities  were  used 
to  conduct  the  simulations  over  a  five  week  period.  During 
each  simulation,  assistance  was  provided  by  the  Warlab  Manager 
to  run  specific  script  files  for  the  Orange  Forces. 
Additionally,  two  other  warlab  technicians  were  used  to  input 
the  reguired  software  entries  for  the  player  for  the  entire 
duration  of  the  wargame.  This  removed  the  requirement  for  the 
players  to  receive  any  prior  training  for  the  RESA  wargame 
environment.  The  subject  was  only  required  to  make  decisions 
and  all  computer  work  was  performed  by  the  technicians. 
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D.  BXPBRnfBNTAL  DESIGN 
1.  Setup 

a.  Physical 

The  RESA  wargeune  was  used  for  all  simulations, 
which  consisted  of  three  personal  computer  workstations  in  one 
bay  of  the  Naval  Postgraduate  School  Warlab.  In  addition,  one 
large  screen  tactical  picture  was  used,  similar  to  those  used 
in  command  centers.  All  players  were  familiar  with  the  Tadil-J 
(Link-11)  symbology  which  was  used  to  represent  various  air 
and  surface  units. 

b.  Test  Subjects 

All  participants  were  U.S.  Naval  Officers  and 
had  attained  either  a  Surface  Warfare  Officer  qualification  or 
were  from  the  Naval  Aviation  Community  and  designated  Pilots 
or  Naval  Flight  Officers.  The  subjects  were  divided  into  four 
groups,  each  receiving  a  particular  level  of  information 
(Appendix  D) .  The  four  groups  consisted  of  an  equal  number  of 
players  from  the  Tac  Air  and  Non  Tac  Air  commxuiities. 

Each  player  had  the  baseline  tactical  knowledge 
required  to  actually  participate  in  the  experiment  because  all 
were  familiar  with  the  Link-11  symbology  used  in  the  wargame. 
There  was  no  requirement  that  a  player  have  previous  wargame 
experience,  but  if  he  did,  the  learning  curve  was  assumed 
negligible.  Technical  assistance  for  software  entries  was 
provided  so  the  player  only  had  to  make  tactical  decisions. 
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This  also  rsBOVsd  any  variance  which  would  have  occurred  due 
to  problems  with  players  entering  software  entries  at 
different  rates  based  on  their  typing  proficiency, 
c.  ScbedulB  of  Trials 

Each  player  was  given  a  hardcopy  briefing  report 
one  day  prior  to  their  participation  in  the  experiment.  This 
report  contained  scenario  background,  the  latest  intelligence 
report,  order  of  battle  for  both  Orange  and  Blue  Forces,  along 
with  a  mission  description  statement  and  the  Rules  of 
Engagement  (ROE).  All  Information  provided  was  unclassified 
since  the  RESA  wargame  is  itself  unclassified.  Four  separate 
intelligence  briefs  were  used  corresponding  to  the  four 
information  levels  (Appendix  E). 

Each  player  was  given  a  30  minute  face-to-face 
strike  brief  prior  to  actually  entering  the  warlab.  This  time 
was  used  to  supplement  aspects  of  the  game  not  covered  in  the 
briefing  report  and  to  answer  any  questions  (Appendix  F). 
General  procedures  for  the  flow  of  the  wargame  were  discussed; 
however,  details  concerning  what  was  being  measured  were  not 
briefed  until  the  completion  of  the  simulation  run. 

After  the  initial  brief,  the  subject  was  sho%m  the 
equipment  configuration  and  proper  procedures  used  to  control 
status  boards  as  well  as  those  used  to  control  display 
Information.  This  15  minute  period  was  used  to  familiarize 
each  player  with  the  simulated  Command  Center  environment. 
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During  this  tine,  each  player  submitted  to  one  of  the  lab 
technicians  a  list  of  aircraft  to  be  used  in  the  assigned 
offensive  strike  mission.  This  was  done  to  enable  the 
technician  to  begin  inputting  data  entries  to  reduce  the  time 
required  to  complete  the  rvm. 

The  assigned  mission  for  each  player  entailed 
conducting  an  offensive  strike  mission  on  a  target  in  North 
Korea  as  well  as  maintaining  an  appropriate  defensive  posture 
(Appendix  G).  In  the  scenario  the  North  Korean  forces  were 
supplied  with  TU-16  Badger  aircraft  to  provide  the  Orange 
Forces  with  a  capable  platform  providing  a  serious  threat  to 
the  CVBG  with  the  AS-5  (Kitchen)  air-to>surface  missile. 

The  scenario  was  designed  to  have  the  player 
develop  a  course  of  action  for  the  airstrike(s)  into  North 
Korea.  Once  North  Korean  airspace  was  violated, the  Orange 
Forces  were  scripted  to  launch  alert  aircraft  in  reaction  to 
the  position  of  the  Blue  Force's  strike  package  aircraft.  A 
scripted  offensive  strike  from  various  airfields  in  North 
Korea  was  then  launched  in  response  to  the  Blue  Forces 
aircraft  (Appendix  H) .  This  required  the  player  to  develop  a 
proper  defensive  strategy  against  raid  aircraft.  To  help 
maintain  the  stress  level  for  the  player,  each  was  required  to 
also  identify  unknown  air  and  surface  tracks  within  a 
determined  radius  around  the  CVBG. 

Additionally,  three  intelligence  updates  were 
provided  to  the  player  at  pre-determined  points  during  the 
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simulation  ( Appendix  I ) .  The  content  of  the  updates 
corresponded  to  the  level  of  information  received  in  the 
Initial  brief. 

At  the  conclusion  of  the  simulation,  the  player 
was  debriefed  on  the  outcome  of  his  run  and  was  asked  to  fill 
out  a  written  debrief  questionnaire  to  be  used  for  qualitative 
analysis  (Appendix  J).  The  player  was  also  told  what 
information  was  being  recorded  as  well  as  the  goal  of  the 
experiment . 

2.  Hypotheses 

•  The  level  of  information  has  no  effect  on  a  player's 
performance  in  a  wargame. 

•  The  player's  warfare  specialty  has  no  effect  on  his 
performance  in  a  wargame. 

3 .  Assumptions 

The  following  factors  were  assumed  at  the  commencement 
of  the  experiment: 

1.  RESA  is  a  valid  model. 

2.  The  data  are  independently  identically  distributed  (lid) 
from  normal  populations  with  equal  variances. 

3.  All  players'  skill  levels  regarding  the  symbology  and 
terminology  were  the  same. 

4.  There  was  no  learning  curve  in  effect,  and  if  a  player 
had  played  RESA  before,  any  learning  curve  effect  would  be 
negligible. 
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4.  Statistical  OMtign  of  Bxperiaent 

The  statistical  design  of  the  experiment  included 
dividing  the  24  participants  into  four  groups  with  an  equal 
allocation  of  tactical  experience  level  within  each  group.  The 
group  assignments  «rere  made  randomly  (Appendix  D).  Data  were 
recorded  for  a  total  of  24  simulation  runs,  with  six  rims  in 
each  resolution  group. 

5.  Measures 

Measurements  focused  primarily  on  aircraft  attrition. 
The  two  primary  measures  were  number  of  Blue  strike  aircraft 
reaching  target  and  number  of  Red  Force  TU-16  Badgers  reaching 
their  weapons  release  range.  Other  measurements  recorded  how 
well  players  actually  complied  with  the  ROE.  Player  debriefs 
aided  in  qualitative  analysis  and  provided  Insight  into  some 
of  the  players'  decisions  during  the  simulation  (Appendix  J). 

B.  IMSTRONERTATIOM 

1.  Warlab  Manager 

The  Warlab  Manager  was  involved  early  in  the  research 
to  implement  the  authors'  scenario  in  RESA.  This  involved 
inputting  the  correct  Orange  and  Blue  Forces  into  their 
respective  units  or  bases.  Computer  script  files  were 
generated  to  provide  all  Orange  Force  movements,  which  were 
based  on  a  tripwire  system.  During  each  simulation,  the  Warlab 
Manager  was  responsible  for  generating  Orange  Force  response 
the  use  of  the  script  files  (Appendix  H).  He  performed 
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this  fvmction  while  manning  a  computer  station  in  a  separate 
area  of  the  War lab,  which  was  not  seen  by  the  player.  At  this 
station  he  was  able  to  constantly  monitor  the  status  of  the 
entire  game  by  the  use  of  a  computer  network,  which  tied  all 
RESA  computers  together.  Additionally,  he  was  responsible  for 
the  proper  scheduling  of  the  simulation  runs  and  ensuring  all 
required  assistance  would  be  available. 

2.  Navy  Technicians 

Two  War lab  technicians  were  utilized  during  the 
simulations  for  inputting  all  software  commands  for  the  Blue 
Force  player.  The  two  U.S.  Navy  Operations  Specialists  had 
been  assigned  to  the  Wa^ldb  Staff,  and  both  had  extensive 
experience  with  the  RES^i  Wargame.  Having  the  same  technicians 
enter  the  data  for  every  run  removed  any  variance  from 
differences  in  typing  abilities  of  the  players.  Thus,  the 
players  could  concentrate  on  keeping  track  of  the  tactical 
picture,  monitoring  status  boards,  and  making  decisions. 

Both  lab  technicians  were  responsible  for  the 
launching  of  all  aircraft  as  per  the  player's  orders.  One 
technician  coordinated  the  actual  overland  strikes  and 
supporting  strike  support  aircraft.  The  second  technician 
coordinated  all  other  aircraft  (i.e.,  defensive  combat  air 
control,  surface  search  aircraft,  airborne  tankers,  and 
helicopters).  The  technicians  were  not  in  an  advisory  role  for 
the  player.  They  responded  to  questions  by  the  player  as  to 
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aircraft  and  weapons  status,  but  did  not  advise  the  player  for 
any  tactical  decisions. 

3.  Authors'  Roles 

During  each  simulation,  one  author  remained  with  the 
player  to  act  In  a  staff  role.  He  ensured  the  player  had  all 
the  correct  displays  required,  translated  the  player's 
commands  Into  entries  for  the  technicians,  and  answered 
questions  concerning  ROE  and  aircraft  status.  The  second 
author  remained  In  the  back  bay  with  the  Warlab  Manager  to 
ensure  the  proper  computer  script  files  had  been  executed  and 
to  act  as  a  liaison  with  the  player  computer  bay. 

P.  MODEL  VERIFICATION 

1 .  Testing 

Once  the  computer  script  files  were  tnrltten  and  coded, 
an  extensive  testing  period  was  required  to  ensure  the  model 
performed  as  expected.  This  period  lasted  approximately  two 
weeks.  It  consisted  primarily  of  changing  numbers  of  Orange 
aircraft  at  various  bases  and  refining  Orange  air-strike 
compositions. 

2 .  Pilot  Trials 

The  final  testing  phase  for  verification  consisted  of 
actually  running  the  simulation  with  players.  First,  the 
authors  played  RESA  and  attempted  to  use  as  many  different 
strike  routes  as  possible  to  ensure  all  script  files  were 
sufficient  in  providing  a  reasonable  force  in  relation  to  one 
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CVBG.  Next,  one  player  was  brought  in  to  play,  and  his  run  was 
used  to  determine  if  the  simulation  was  valid.  His  run  was  not 
used  in  any  analysis.  After  the  final  pilot  trial,  the 
technicians  and  the  Warlab  Manager  had  participated  in  six 
practice  runs  and  were  extremely  proficient  at  all  software 
commands  the  game  required. 

6.  DATA  DESCRIPTION 

1.  Description  of  Scripted  Scenarios 

The  computer  script  files  were  based  on  a  tripwire 
system  and  were  executed  in  response  to  the  actions  of  the 
Blue  Forces.  The  initial  scripts  were  based  on  surveillance 
rings  around  North  Korean  bases.  When  Blue  Force  aircraft 
arrived  Inside  these  rings,  intercept  aircraft  were  launched. 
Additional  script  files  were  written  to  add  commercial  air 
traffic  and  North  Korean  military  training  flights  into  the 
simulation.  The  final  script  files  created  a  three  axis  Orange 
Force  offensive  action  on  the  carrier  Battle  Group  (Appendix 
H). 

2.  Data  Collection 

Data  were  collected  primarily  by  computer  resources  in 
the  form  of  an  engagement  log  which  kept  track  of  all  aircraft 
losses  (Appendix  K) .  In  addition,  an  aircraft  tally  log  was 
maintained  which  included  strike  package  numbers  as  well  as 
the  mission  for  each  aircraft  (Appendix  L) . 
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3.  Data  Collection  Probleas 


There  were  three  runs  which  had  to  be  excluded  because 
of  data  collection  problems-  The  authors  felt  the  data  were 
invalid  for  the  three  runs  because  of  a  misunderstanding  of 
orders.  Consequently,  the  player's  forces  either  suffered 
excessive  attrition  rates  or  attrited  excessive  Orange  Forces. 
The  problems  were  technical  in  nature  and  were  no  fault  of  the 
player,  so  the  data  were  deemed  unusable.  Because  of  this 
problem,  out  of  the  27  runs  actually  completed,  only  24  of  the 
runs  were  counted  in  the  analysis  portion. 
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IV.  AHALYSIS 


A.  AHALYSIS  PLAN 

The  data  were  analyzed  both  quantitatively  and 
qualitatively.  The  quantitative  approach  was  twofold.  First, 
statistically  significant  correlations  between  the  two 
different  warfare  coninunities  and  the  four  levels  of 
intelligence  information  were  determined.  Second,  a  mean 
value  differential  analysis  was  performed  on  applicable 
factors  to  assess  the  relative  amount  of  change  in  the 
measures  of  effectiveness  with  regard  to  warfare  community  and 
intelligence  information  level. 

The  qualitative  approach  consisted  of  subjectively 
reviewing  the  Player  Debrief  Forms  (Appendix  J)  to  determine 
if  any  trends  existed  in  the  planning  and  execution  of 
individual  player  strategies.  This  method  permitted  the 
interjection  of  likely  reasons  to  explain  the  results  of  the 
quantitative  analysis. 

B.  PROCEDURE 

The  analysis  methods  described  above  were  employed  to 
determine  what  effects  warfare  specialty  and  intelligence 
information  levels  had  on  the  ability  of  a  CVBG  commander  to 
successfully  conduct  an  air  strike  against  a  land  target  while 
simultaneously  maintaining  an  active  CVBG  defensive  posture. 


First,  Measures  of  Performance  (MOPs)  are  discussed  to  provide 
a  baseline  for  player  performance.  Second,  important 
Measures  of  Effectiveness  (MOEs)  are  derived  from  the  MOPs  to 
accurately  reflect  player  effectiveness  in  mission  attainment. 
This  established  the  relationship  between  the  data  collected 
and  the  MOEs  identified.  Third,  the  investigation  methodology 
is  outlined  to  establish  the  format  of  the  analysis.  Finally, 
the  analysis  was  performed  to  gain  insight  into  the  research 
questions . 

1.  Measures  of  Performance  (MOPs) 

MOPs  indicate  the  performance  level  of  a  system  or 
collection  of  systems  in  accomplishing  its  designed  task.  In 
the  RESA  simulation  these  attributes  are  reflected  in  the 
various  status  tables  available  during  the  game.  In  addition, 
various  summaries  are  compiled  at  the  completion  of  play  for 
further  review.  These  summaries  are  described  below. 

The  Detection  Log  is  a  record  of  all  radar,  electronic 
and  visual  observations  Identified  by  both  forces.  It  is, 
therefore,  a  reflection  of  a  platform's  identification  system 
performance. 

The  Position  Log  chronicled  the  geographic  position  of 
every  vinit  at  various  points  in  time.  This  log  is  an 
indication  of  an  element's  tracking  system  performance. 

The  Engagement  Log  provided  a  record  of  every 
engagement  between  Blue  and  Orange  forces.  The  data  included 
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tine  of  engagement,  forces  involved,  weapons  utilized,  hits  or 
misses  and  targets  destroyed.  This  log  is  an  indication  of  a 
unit's  targeting  system  and  engagement  performance. 

2.  Measures  of  Effectiveness  (NOEs) 

MOEs  can  be  thought  of  as  indicators  that  reflect  "how 
much"  better  one  system  is  compared  to  another.  (Thomas,  1985, 
pi)  Generally,  one  MOE  cannot  adequately  characterize  all  the 
actions  and  interactions  that  take  place  among  the  principle 
variables;  therefore,  several  NOEs  are  often  utilized  to  help 
describe  the  behavior  of  the  variables.  For  this  reason  MOEs 
should  not  be  considered  as  solely  measures  of  optimization, 
but  also  as  measures  that  indicate  degrees  of  variable 
interactions.  (Thomas,  1985,  p6)  Recall  that  the  following 
research  questions  posed  for  analysis  in  Chapter  I  were  as 
follows: 

•  What  is  the  effective  improvement  or  degradation,  if  any, 
to  the  striking  capability  of  the  battle  group  if  c*I  is 
improved? 

•  What  is  the  effective  improvement  or  degradation  to  the 
defensive  capability  of  the  battle  group  if  C*l  is 
improved? 

•  How  effective  is  C*l  as  a  Battle  Group  Force  Multiplier  in 
a  Littoral  Environment? 

In  order  to  effectively  answer  these  questions,  MOEs 
that  correctly  measure  the  degree  of  change  in  offensive  and 
defensive  capabilities  are  important.  Once  these  capabilities 
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are  determined,  the  results  can  be  aggregated  to  reflect  the 
effectiveness  of  C*I  as  a  Force  Multiplier. 

The  relevant  MOEs  derived  from  the  Engagement  Log  were 
as  follows: 

(1)  Number  of  strike  aircraft  reaching  target 

(2)  Number  of  strike  aircraft  reaching  target  based  on  the 
number  of  strike  packages 

(3)  Percent  of  strike  aircraft  reaching  target 

(4)  Percent  of  strike  aircraft  reaching  target  based  on  the 
number  of  strike  packages 

(5)  Number  of  Orange  Badger  aircraft  attrited  prior  to 
weapon  release  point 

(6)  Number  of  Orange  Badger  aircraft  attrited  prior  to 
weapon  release  point  based  on  the  number  of  defensive  (CAP) 
aircraft  laiinched. 

The  first  four  MOEs  directly  measure  the  offensive 
capabilities  of  the  player  and  thus  will  be  used  to  analyze 
the  first  research  question.  The  last  two  MOEs  measure  the 
defensive  skill  of  the  player  and  will  be  used  to  examine  the 
second  research  question.  The  final  question  will  be  answered 
by  aggregating  the  first  two  MOEs  into  an  overall 
effectiveness  measure. 

3 .  Analysis  Factors 

Each  of  the  above  listed  MOEs  were  applied  with  regard 
to  warfare  specialty  and  information  level.  Since  only  two 
warfare  communities  were  utilized,  this  approach  was  straight¬ 
forward.  Information  levels  were  considered  in  the  four 
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specified  levels  and  also  by  combining  the  two  lowest  tiers 
(level  0  and  1)  and  the  two  highest  tiers  (level  2  and  3)  for 
a  total  of  two  levels.  This  was  done  primarily  because  there 
was  a  distinct  break  in  the  quality  of  information  provided 
between  level  1  and  2.  This  difference  in  information 
primarily  related  to  detection  and  engagement  ranges  as  well 
as  more  accurate  information  on  enemy  force  quantities  and 
locations  (Appendix  E). 

Additionally,  the  niimber  of  air  intercepts/escorts  and 
surface  contact  identifications  was  analyzed  to  evaluate  how 
well  the  ROE  was  followed.  A  final  study  was  conducted  to 
ascertain  the  importance  of  the  intelligence  brief /updates 
provided  to  the  players. 

C.  METHODOLOGY 

Appendix  M  contains  a  comprehensive  analysis  of  the  data 
collected.  Numerous  one-way  analyses  of  variances  (ANOVAs) 
were  conducted  to  determine  if  statistically  significant 
relationships  existed.  Most  of  the  ANOVAs  did  not  reveal 
significant  differences  between  the  variables.  Although 
twenty-four  subjects  participated  in  the  experiment,  they  were 
effectively  divided  into  eight  groups  (Appendix  0).  This 
reduced  the  sample  size  of  each  group  to  three;  therefore, 
statistically  significant  values  could  not  be  expected  with 
such  a  small  sample  size.  In  order  to  further  analyze  the 
data  for  trends,  a  mean  value  differential  analysis  was 
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perforned,  allo«fing  the  differences  in  means  to  be  evaluated. 
Charts  depicting  various  relationships  were  also  utilized  when 
necessary  to  emphasize  significant  trends. 

The  following  summary  briefly  explains  the  format  of  the 
analysis  methodology  and  layout  of  Appendix  M.  The  first  MOE 
(number  of  strike  aircraft  reaching  target)  will  be  used  as  an 
example  to  describe  the  procedure  utilized  in  the  analysis  of 
all  MOEs. 

1.  Analysis  of  Variance  (ANOVA) 

The  first  step  was  to  utilize  the  one-way  ANOVA  to 
analyze  the  variances  on  the  MOE  with  regard  to  warfare 
specialty  and  information  level.  Information  level  was 
evaluated  for  both  communities  combined  and  separately 
(Appendix  N,  Sections  A  through  D).  The  relevant  hypotheses 
for  part  A  are  as  follows: 

•  H,:  The  mean  number  of  aircraft  reaching  the  target  is  the 
same  for  both  communities,  i.e.,  the  means  are  equal. 

•  Hx:  The  mean  number  of  aircraft  reaching  the  target  is  not 
the  same  for  both  communities,  i.e.,  the  means  are  not 
equal. 

The  question  that  the  hypotheses  address  is:  "Are  these 
outcomes  the  same?" 

The  important  features  of  the  ANOVAs  are  the  mean 
values,  confidence  Intervals  and  P-values.  The  mean  number  is 
simply  the  average  value  observed  for  the  particular  treatment 
level.  In  this  example  the  mean  number  of  aircraft  reaching 
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the  target  was  18.583  and  18.167  for  the  TACAIR  and  NON-TACAIR 
conunities,  respectively  (Appendix  M,  Section  A). 


The  confidence  intervals  are  all  based  on  a  95%  level 
of  confidence  which  means  that  the  probability  is  95%  that  the 
internal  includes  the  true  mean  value.  In  this  example  the 
observed  mean  values  are  depicted  on  the  confidence  intervals 
and  the  range  of  the  Intervals  represent  the  area  in  which  the 
true  value  lies  with  probability  of  95%.  The  issue  is  whether 
or  not  these  intervals  overlap.  If  they  do,  then  the  result 
is  that  there  is  no  difference  between  the  numbers;  however, 
if  they  do  not  overlap,  then  the  numbers  can  be  judged 
different. 

The  P-value  represents  the  lowest  level  of 
significance  at  which  the  null  hypothesis  can  be  rejected.  In 
other  words,  it  is  the  smallest  level  at  which  the  results  are 
significant.  In  this  example  these  numbers  could  be  judged 
different  if  a  10%  level  of  confidence  is  acceptable,  since 
the  P>value  is  0.898.  This  value  is  obtained  by  subtracting 
the  P-value  from  l. 

In  the  analyses  of  all  the  NOES,  a  confidence  interval 
of  95%  was  selected  and  thus  the  P-value  has  to  be  less  than 
or  equal  to  0.05  for  the  determination  that  there  is  a 
difference  between  the  treatment  values. 
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2.  Mmui  ValiM  Diffarantial  Analysis  (MVDA) 

The  naxt  stap  was  to  exaalna  how  much  deviation  there 
was  between  the  observed  value  and  the  aean.  This  pemitted 
the  observation  of  important,  although  not  statistically 
significant,  trends.  This  analysis  was  performed  only  for 
Information  levels  since  the  differences  from  the  mean  for 
warfare  specialties  is  easily  recognizable.  This  analysis  was 
performed  for  both  four  and  t%fo  levels  of  information. 

3.  Graphs  and  Charts 

Appropriate  graphs  and  charts  were  utilized  to 
supplement  the  ANOVAs  and  in  some  instances  in  place  of  the 
mean  value  differential  analysis  and  are  contained  in  Append!  z 
N.  This  was  the  case  in  the  examination  of  the  number  and 
percentage  of  aircraft  arriving  on  target  with  regard  to 
strike  packages  launched,  and  with  the  number  of  Badger 
aircraft  destroyed  based  on  the  number  of  CAP  aircraft 
launched.  In  these  instances  the  graphs  and  charts  more 
clearly  depict  the  significant  trends. 

D.  RESULTS 

1.  iharitMr  of  Strike  Aircraft  reaching  the  Target 

This  value  was  utilized  to  measure  the  actual  amount 
of  ordnance  placed  on  the  target.  Since  the  ordnance  loadout 
of  each  type  aircraft  was  pre>determined  (Appendix  E,  Section 
E),  the  amount  of  ordnance  delivered  was  directly  related  to 
the  number  of  aircraft  arriving  on  target.  The  effects  of 
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warfare  specialty  and  Inforeation  level  were  examined  to 
assess  their  impact  on  the  number  of  aircraft  reaching  the 
target. 

a.  iTar/are  Specialty 

The  mean  number  of  strike  aircraft  reaching  the 
target  was  not  solely  dependent  upon  the  community.  The  ANOVA 
did  not  show  any  statistically  significant  relationship.  In 
fact,  both  communities  were  able  to  put  slightly  more  than 
eighteen  aircraft  over  the  target  (Appendix  M,  Section  A) . 

b.  Information  Loral 

The  importance  of  information,  although  not 
statistically  significant,  had  an  impact.  A  mean  differential 
analysis  showed  an  increase  in  the  mean  number  of  aircraft 
reaching  the  target  as  the  information  level  increased  (4 
levels).  The  mean  differential  analysis  for  the  first  MOE  is 
summarized  in  the  table  of  Appendix  M,  Section  E.  The  grand 
mean  is  the  mean  value  of  the  entire  population  (all  twenty- 
four  values).  This  value  is  divided  into  three  mean  values 
representing  combined,  TACAIR  and  NON-TACAIR.  These  values 
are  the  mean  of  means  for  each  of  the  three  categories  and  are 
derived  from  section  B  through  D,  respectively.  For  example, 
the  mean  number  for  the  TACAIR  community  is  18.583  which 
corresponds  to  the  value  obtained  above  in  the  ANOVA,  warfare 
specialty  analysis.  This  number  is  also  the  mean  number  from 
the  four  information  levels  of  part  C.  The  mean  differential 
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is  obtained  by  conparing  the  nean  value  fron  each  information 
level  with  the  mean  from  its  respective  coanunity.  For  this 
example  the  mean  for  TACAIR  level  o  is  18.00  which  is  0.583 
less  than  the  mean  for  TACAIR,  thus  the  differential  for 
information  level  0  is  -0.583.  All  other  values  are  obtained 
in  a  similar  manner.  This  analysis  highlights  the  fact  that 
an  increasing  trend  in  the  number  of  aircraft  reaching  the 
target  from  each  warfare  community  individually  and  combined 
occurred  as  the  information  level  increased  up  to  level  2; 
however,  the  value  decreased  for  level  3.  It  also  shows  that 
the  NON-TACAIR  community  experienced  the  greatest  improvement 
and  least  degradation  since  the  differences  between  levels  was 
greatest  between  0,  1  and  2  while  at  the  same  time  less 
between  2  «uid  3.  Figure  1  is  from  Appendix  N,  Section  E  and 
is  reproduced  below. 
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Figure  1:  MVOA  of  Number  of  aircraft  reaching  the  target 
based  on  four  information  levels. 

The  mean  number  of  aircraft  reaching  the  target  increased  from 
the  mean  value  for  both  communities  combined  and  individually 
up  to  information  level  2;  however,  the  value  decreased  at 
level  3.  This  result  was  contrary  to  what  was  expected.  It 
was  anticipated  that  the  performance  would  steadily  increase 
as  information  level  increased.  The  reason  for  this  is  not 
totally  clear;  however,  some  possible  reasons  are  discussed. 

The  explanation  might  be  attributed  to  the  number  of 
strike  packages  launched.  It  was  noticed  that  individuals 
that  launched  more  strike  packages  tended  to  lose  more 
aircraft  (MOE  2).  Another  factor  may  be  because  the  player 
did  not  have  a  staff  to  help  him  manage  the  intelligence  data 
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and  track  synbology.  A  third  reason  may  be  due  to  the  random 
distribution  of  players  into  the  four  categories.  The  level 
3  participants  may  have  had  a  "lower"  skill  level  than  the 
rest  of  the  population. 

The  results  for  two  information  levels,  on  the  other 
hand,  were  significantly  different.  The  NON-TACAIR  community 
showed  an  improvement  in  the  nvimber  of  aircraft  reaching  the 
target  but  the  reverse  was  true  for  the  TACAIR  community. 
Figure  2  from  Appendix  M,  Section  I  is  the  mean  differential 
analysis.  This  might  also  be  attributed  to  the  number  of 
strike  packages  launched. 
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Figure  2:  MVDA  of  number  of  aircraft  reaching  target  based 
on  two  information  levels. 
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2.  NiaiMr  of  strike  aircraft  reaching  target  t>ased  on  the 
mistier  of  strike  packages 

As  the  number  of  strike  packages  launched  increased, 
the  number  of  aircraft  reaching  the  target  decreased  (Appendix 
M,  Sections  S  through  AL) .  Figure  3  is  from  Appendix  M, 
Section  Z  and  shows  the  relationship  between  aircraft  reaching 
the  target  and  strike  packages  launched  for  both  communities 
combined. 


Figure  3:  Number  of  aircraft  reaching  target  based  on  number 
of  strike  packages  launched. 


a.  WarfarB  Specialty 

The  mean  number  of  strike  packages  launched  was 
dependent  upon  the  community.  The  TACAIR  community  launched 
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a  mean  of  1.5  strike  packages  compared  to  the  1.917  from  the 
NON  TACAIR  (Appendix  M,  Section  T  and  AA) . 
b.  Information  Level 

The  number  of  strike  packages  launched  by  each 
community  was  affected  by  the  information  level  received.  The 
TACAIR  community  had  less  variance  in  the  number  of  strike 
packages  launched  as  information  level  increased.  The  mean 
number  launched  was  1.67  for  levels  0,  1  and  3,  and  l  for 
level  2  (Appendix  M,  Section  AB) .  This  resulted  in  a 
noticeable  increase  in  the  number  of  aircraft  on  target  at 
information  level  2  (MOE  1  analysis).  The  NON  TACAIR 
community  had  more  variance  in  the  number  of  strike  packages 
launched  as  information  level  increased.  The  mean  number 
launched  was  2,  2,33,  1.67  and  1.67  for  levels  0  through  4, 
respectively  (Appendix  Section  AC).  The  larger  difference 
in  the  mean  number  of  strike  packages  launched  between  level 
1  and  2  contributed  to  the  larger  mean  value  differential  as 
described  in  the  MOE  1  analysis.  An  interesting  fact  is  that, 
except  for  the  one  instance  when  three  strike  packages  were 
launched,  this  community  was  able  to  get  more  of  their 
aircraft  to  the  target  (Appendix  M,  Section  U  through  Y,  AB 
and  AC) . 

The  analysis  when  based  on  two  information  levels 
illustrates  that  both  communities  launched  fewer  strike 
packages  as  the  information  level  increased  and  thus  were  able 
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to  put  a  greater  number  of  aircraft  on  target.  The  difference 
in  the  number  of  packages  launched  from  the  NON-TACAIR 
community  was  greater  than  for  the  TACAIR  community  as  the 
information  level  increased.  This  difference  highlights  why 
the  NON-TACAIR  community  exhibited  more  improvement  in  getting 
the  strike  aircraft  to  the  target  (MOE  1  analysis).  Figure  4 
is  from  Appendix  M,  Section  AL  and  depicts  this  result. 


Figure  4:  Number  of  strike  packages  launched  based  on  two 
information  levels  (both  communities). 


In  both  cases  (4  levels  and  2  levels)  as  the 
n^ullber  of  strike  packages  increased  the  amount  of  effort 
required  to  manage  the  strike  groups  expanded.  This  caused 
many  players  to  "lose  the  big  picture"  and  inhibited  their 
ability  to  effectively  manage  the  strike  packages. 
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3.  Percent  of  strike  aircraft  reaching  target 


This  NOE  is  utilized  because  it  provides  a  different 
aspect  on  overall  performance  in  getting  strike  aircraft  to 
the  target.  The  actual  number  of  strike  aircraft  launched 
varied  from  8  to  34  aircraft;  consequently,  the  number 
reaching  the  target  can  be  misleading  as  to  the  player's 
actual  performance.  For  example,  suppose  player  "A"  launched 
10  aircraft  and  9  reached  the  target,  and  player  "B**  launched 
30  aircraft  and  15  reached  the  target.  Based  on  the  number  of 
aircraft,  player  "B”  did  better,  but  he  lost  50%  of  his 
aircraft  while  player  "A"  only  lost  10%.  Unfortunately  the 
percent  of  aircraft  reaching  the  target  does  not  give  any 
indication  of  how  many  aircraft  were  launched,  or  reached  the 
target,  and  thus  how  much  ordnance  was  dropped.  Nonetheless, 
it  is  an  important  NOE. 

a.  WarfarB  Specialty 

The  mean  percent  of  strike  aircraft  reaching  the 
target  was  dependent  upon  the  community.  Although  the  ANOVA 
did  not  show  a  statistically  significant  relationship,  a 
definite  difference  was  noted  between  the  communities.  The 
TACAIR  community's  performance  was  13%  better  (Appendix  M, 
Section  J) . 

b.  Information  Level 

Information  level  was  an  important  factor  in 
determining  the  percentage  of  strike  aircraft  reaching  the 
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target.  The  mean  value  differential  analysis  showed  an 
increase  in  the  mean  percentage  of  aircraft  reaching  the 
target  as  the  information  level  increased  (4  levels)  with  the 
highest  increase  occurring  at  information  level  2.  Figure  5 
is  from  Appendix  Section  N  and  shows  this  result. 


target  based  on  four  information  levels. 

Again,  the  player  performance  at  level  3  decreased  slightly 
from  the  previous  level.  The  possible  reasons  for  this  may 
also  be  attributed  to  those  discussed  in  the  previous  MOE. 

The  results  for  two  information  levels  was  similar 
although  not  as  dramatic  (Appendix  E,  Section  R) .  As  was  the 
case  in  the  number  of  aircraft  that  reached  the  target,  the 
NON  TACAIR  community  showed  the  greatest  improvement. 
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4.  Percent  of  strike  aircraft  reaching  target  based  on 


the  nvutfier  of  strike  packages 

The  percentage  of  aircraft  arriving  at  the  target  was 
similar  to  the  number  when  based  on  the  number  of  strike 
packages  launched;  that  is,  a  higher  percentage  reached  target 
with  less  strike  packages.  Figure  6  is  from  Appendix  M, 
Section  AP  and  shows  the  percentage  of  aircraft  with  regard  to 
the  number  of  strike  packages. 


Figure  6:  Percent  of  aircraft  reaching  the  target  based  on 
niamber  of  strike  packages  launched. 

a.  Ifarfare  Specialty 

The  percentage  of  strike  aircraft  reaching  the 
target  was  also  dependent  upon  the  community;  however,  in  this 
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case  the  TACAIR  comnunity  did  appreciably  better  when  one 
strike  package  was  launched  and  slightly  better  when  two  were 
launched.  Figure  7  is  from  Appendix  M,  Section  AQ  and  shows 
the  relationship  between  percentage  of  aircraft  arriving  on 
target  and  strike  packages  launched  for  both  communities. 


Figure  7:  Percent  of  aircraft  reaching  the  target  based  on 
the  number  of  strike  packages  launched. 

b.  Information  Laval 

Information  level  has  no  bearing  on  the  percent  of 
aircraft  reaching  the  target  since  information  level  only 
affects  the  selection  of  the  number  of  strike  packages 
launched.  See  NOE  2  for  analysis  of  the  effect  of  information 
level  on  the  number  of  strike  aircraft  reaching  target  based 
on  the  ntimber  of  strike  packages. 
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5.  umber  of  Orange  Badger  aircraft  attrited  prior  to 

weapon  release  point 

The  defensive  expertise  of  the  players  was  primarily 
measured  by  the  number  of  Orange  Badger  aircraft  destroyed 
before  reaching  their  weapon  release  point.  The  total  number 
of  Badger  aircraft  launched  to  attack  the  CVBG  was  fifteen 
aircraft  for  every  scenario.  The  Badgers  conducted  a  three 
axis  strike  as  outlined  in  Appendix  H. 

a.  Warfare  Specialty 

Neither  community  eliminated  significantly  more 
aircraft  than  the  other.  In  fact,  both  warfare  specialties 
destroyed  slightly  more  than  five  Badgers  (Appendix  M,  Section 
AR). 

b.  Information  Level 

The  number  of  Badgers  killed  based  on  four  levels 
of  information  was  slightly  better  at  level  l  for  the  TACAIR 
commixnity  and  partially  better  at  level  2  for  the  NON  TACAIR 
community  (Appendix  M,  Sections  AS  through  AV) .  Figure  8  is 
the  mean  value  differential  analysis  from  Appendix  M,  Section 
AV  and  shows  the  result.  The  possible  explainations  for  this 
level  3  result  are  the  same  as  those  previously  outlined. 
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Figure  8:  NVDA  of  the  lumber  of  Badger  aircraft  killed  based 
on  four  infomation  levels. 

The  results  based  on  two  infomation  levels  is 
even  less  significant  (Appendix  H,  Section  AZ). 

6.  Muaber  of  Orange  Badger  aircraft  attrited  prior  to 
weapon  release  point  based  on  the  nusber  of  defensive 
(CAP)  aircraft  launched 

This  NOE  was  selected  because  it  measures  the  nvuaber 
of  Badger  aircraft  attrited  as  a  function  of  CAP  aircraft 
launched.  As  the  number  of  CAP  aircraft  launched  increases, 
the  number  of  Badger  aircraft  destroyed  should  increase 
(Appendix  N,  Section  BA  through  BK) .  Both  communities 
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coBbin«d  launched  between  eight  and  twenty-four  aircraft. 
Figure  9  is  from  Appendix  M,  Section  BA  and  BF  and  depicts  the 
result . 


Figure  9:  Number  of  Badger  aircraft  killed  based  on  the 
number  of  CAP  aircraft  launched. 


a.  Warfare  Specialty 

The  mean  number  of  CAP  aircraft  launched  for  both 
communities  was  slightly  more  than  thirteen  (Appendix  M, 
Section  BB) . 

b.  Information  Level 

The  TACAIR  community  launched  slightly  more  CAP 
aircraft  at  information  level  1  and  3  and  slightly  less  at 
information  level  2  (Appendix  H,  Section  BD) .  The  NON  TACAIR 


comunity  was  consistent  with  the  previous  analyses  by 
launching  an  increasing  anount  of  CAP  aircraft  as  the 
infomation  level  increased  peaking  at  level  2  and  then 
decreasing  slightly  at  level  3.  Figure  10  is  the  mean 
differential  analysis  and  depicts  the  results. 


Figure  10:  MVDA  of  the  nxmber  of  CAP  aircraft  launched  based 
on  four  information  levels. 
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The  results  based  on  two  information  levels 
actually  show  that  the  TACAIR  community  launched  less  CAP  as 
the  information  level  increased  while  the  NON  TACAIR  community 
launched  more  (Appendix  N,  Sections  BH  through  BK).  Figure  11 
portrays  this  result.  Although  there  was  no  clear  reason  why 
this  occured,  a  possible  explanation  may  be  that  the  TACAIR 
players  felt  they  had  a  better  understanding  on  the  amount  of 
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CAP  aircraft  that  would  be  required  to  adequately  protect  the 
CVBG.  The  NON  TACAIR  players,  on  the  other  hand,  may  not  have 
felt  comfortable  with  the  number  of  CAP  aircraft  that  would  be 
required  and,  therefore,  launched  more. 


E.  RULES  OF  ENGAGEMENT 

Rules  of  engagement  were  established  for  two  reasons. 
First,  they  provided  structure  to  the  game  ensuring  that  all 
players  followed  the  same  engagement  procedures  (Appendix  D, 
Section  C).  Second,  it  was  utilized  as  a  secondary  HOE  to 
evaluate  the  player's  command  and  control  ability  with  regard 
to  defensive  force  management.  The  player  was  required  to 
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identify  selected  airborne  and  surface  contacts.  This  demand 
kept  the  player  busy  while  the  strike  package  was  being 
assembled  and  enroute  to  the  target  as  well  as  added  a  degree 
of  realism  to  the  scenario. 

All  players  complied  with  the  ROE  with  regard  to 
engagements  and  no  significant  deviations  were  observed.  It 
was  also  expected  that  there  would  be  no  difference  in  the 
number  of  unkno%m  contacts  identified.  The  result  was  that 
neither  community  performed  better  than  the  other  In  contact 
Identification.  In  fact,  the  mean  number  of  contacts 
identified  for  both  communities  was  exactly  8.75  each 
(Appendix  M,  Section  BL) .  The  mean  value  differential 
analysis  based  on  four  and  two  levels  of  Information  did  not 
show  any  appreciable  difference  as  Information  level  varied 
(Appendix  M,  Sections  BM  through  BO) . 

F.  INFORIIATIOIf  BRIEF  RELEVANCE 

The  factors  contained  in  the  "Initial  Intelligence  Brief 
were  examined  for  relevant  information  to  player  strategy 
development.  The  initial  brief  contained  background 
information  and  was  constant  In  all  levels  of  information; 
however,  the  specific  information  about  Orange  defensive 
strategy  and  the  composition  of  forces  at  each  base  varied 
among  levels  of  information  (Appendix  E,  Sections  B  through 
E) .  Each  brief  contained  pertinent  information  in  the 
following  six  areas;  aircraft,  surface-to-air  missiles  (SAM), 
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defensive  strategy,  operational 


radar  survei 1 lance , 

cowiunications  and  logistic  infomation.  During  the  debrief, 
each  player  was  queried  about  the  relevance  of  each  type  of 
information  and  asked  to  rank  the  importance  of  each.  The 
most  important  factors  identified  were  SAM  information, 
aircraft  data  and  radar  surveillance  information.  Although 
there  was  some  minor  deviations  in  the  exact  ranking  of  each 
factor  with  regard  to  community  and  information  level,  these 
three  clearly  were  most  important  (See  Appendix  M,  Sections  BP 
through  BR  for  further  details). 

6.  QUALITATIVE  ANALYSIS 

This  analysis  consisted  of  reviewing  all  the  players'  post 
mission  debriefs  for  trends.  This  form  was  divided  into  two 
major  sections:  Mission  Planning  and  Intelligence  Data 
(Appendix  J).  First,  the  data  were  examined  based  on  warfare 
specialty  to  determine  if  either  community's  strategy  was 
different.  Second,  the  data  were  evaluated  based  on 
information  level.  The  data  were  also  analyzed  based  on 
warfare  specialty  and  information  level  but  there  was  not  any 
significant  differences  noted. 

1 .  Warfare  Specialty 

Both  communities'  choice  of  ingress  route(s)  were 
based  on  the  desire  to  avoid  major  population  centers  and 
military  Installations,  and  minimize  the  amovint  of  time  that 
the  strike  package(s)  were  in  enemy  territory.  Specific 


attention  was  given  to  radar,  SAM  site  and  enemy  fighter 
aircraft  avoidance. 


The  number  and  type  of  aircraft  selected  for  the 
strike  package(s)  was  also  similar  for  each  community.  The 
desire  to  inflict  maximum  damage  and  provide  sufficient 
support  for  the  attacking  aircraft  were  uniformly  stressed. 
Both  communities  also  placed  significant  emphasis  on  defense 
of  the  CVB6;  however,  this  concern  was  slightly  greater  in  the 
NON-TACAIR  community. 

The  selection  of  strike  aircraft  egress  route(s)  was 
common  between  communities.  The  over-riding  factor  was  the 
desire  to  take  the  shortest,  most  direct  path  to  expedite  the 
egress.  The  NON-TACAIR  players  were  more  likely  to  modify 
their  egress  plans  and  tedce  different  routes  if  significant 
opposition  was  encountered  on  the  primary  route.  The  TACAIR 
players  were  more  likely  to  utilize  their  pre-determined  route 
even  if  strong  opposition  was  encountered. 

Both  communities  were  also  similarly  satisfied  with 
the  initial  intelligence  briefs  and  considered  them  helpful  in 
strategy  planning.  Neither  warfare  specialty  considered  the 
intelligence  updates  especially  essential;  however,  the  TACAIR 
players  felt  they  were  slightly  more  helpful  than  did  the  NON- 
TACAIR  people. 
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2 .  Inf onation  Level 


Ingress  route(s)  were  selected  to  expedite  the  strike 
and  minimize  the  amount  of  time  in  enemy  territory.  The 
route(s)  utilized  sought  to  avoid  population  centers  and 
military  bases.  As  the  levels  of  information  increased,  the 
players  incorporated  the  increased  knowledge  about  the  enemy 
disposition  into  their  ingress  plan;  however,  this  did  not 
appreciably  alter  the  route(s)  selected;  a  direct  route  was 
still  preferred. 

The  number  and  type  of  aircraft  selected  for  the 
strike  did  not  vary  significantly  between  information  levels. 
Maximizing  ordnance  placed  on  target  was  emphasized  and 
protection  of  the  CVBG  was  considered;  however,  the  players 
with  the  "Low"  information  level  expressed  the  greatest 
concern  for  CVBG  defense. 

Selection  of  egress  route(s)  was  influenced  by  the 
desire  to  utilize  a  direct  route  which  provided  the  guickest 
path  to  exit  the  enemy  country.  No  specific  group 
demonstrated  any  significant  desire  to  alter  their  route  as 
the  information  level  increased. 

The  usefulness  of  the  initial  intelligence  brief  and 
update  messages  varied  from  each  level.  The  players  in  the 
"Very  Low"  and  "Low"  categories  felt  the  information  lacked 
details  with  regard  to  enemy  type  and  number  of  aircraft, 
radar  ranges,  SAM  sites  and  defensive  strategy;  therefore, 
they  did  not  feel  the  information  provided  helped  them  perform 
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the  nlsslon.  The  update  messages  provided  information  that 
something  was  happening,  but  was  not  specific  enough  to  alter 
postures.  The  "Medium"  and  "High"  level  people  were  more 
supportive  of  the  value  of  the  initial  intelligence  brief. 
They  were  provided  with  more  details  and  thus  were  able  to 
glean  more  valuable  information  from  the  brief;  however,  this 
information  did  not  significantly  alter  the  selection  of 
ingress  of  egress  route(s).  It  did  give  a  more  complete 
picture  of  the  opposition  and  the  updates  were  more  valuable 
in  that  they  provided  a  better  warning  about  the  retaliatory 
strike.  Unfortunately  these  groups  did  not  perform  any  better 
with  regard  to  destroying  the  attacking  Badger  aircraft,  nor 
did  they  get  more  aircraft  over  the  target,  especially  at 
level  3. 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  ANTICIPATED  RESULTS 

The  purpose  of  the  experiment  was  to  determine  if  tactical 
performance  in  the  RESA  wargame  was  different  with  respect  to 
information  provided  as  well  as  trying  to  determine  if  the 
members  of  the  Tactical-Air  community  performed  any 
differently  than  the  Non-Tactical-Air  community.  Prior  to  the 
experiment,  the  authors  expected  that  there  would  be  an 
incremental  improvement  in  both  offensive  and  defensive 
performance  within  each  of  the  warfare  communities  as  the 
level  of  information  increased.  It  was  also  anticipated  that 
the  players  with  more  Tactical-Air  experience  would  have 
better  results  than  those  players  in  the  Non-Tactical-Air 
category.  The  following  conclusions  will  attempt  to  explain 
the  three  primary  research  questions  stated  earlier,  as  well 
as  suggest  some  possible  reasons  for  results  that  differed 
from  what  was  anticipated  by  the  authors. 

B.  CONCLUSIONS 

1 .  Offensive  Performance 

The  offensive  performance  of  all  players  was 
determined  by  examining  the  first  four  MOEs  defined  in  Chapter 
IV.  These  MOEs  measured  the  total  number  of  strike  aircraft 
reaching  the  target,  percentage  of  strike  aircraft  reaching 
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the  target,  as  well  as  both  of  these  categories  based  on  the 
nunber  of  strike  packages  launched. 

The  analysis  indicates  that  warfare  specialty  had  no 
effect  on  the  total  number  of  strike  aircraft  to  actually 
strike  the  target.  However,  since  each  player  chose  both  the 
size  and  number  of  the  strike  packages  required  to  accomplish 
the  mission,  the  total  number  of  aircraft  to  reach  target  as 
well  as  percentage  of  the  strike  aircraft  launched  to  actually 
reach  target  are  both  important.  Both  communities  were  able  to 
get  approximately  the  same  mean  number  of  aircraft  to  the 
target.  However,  with  percentage  of  aircraft  over  target  being 
a  function  of  number  of  strike  aircraft  initially  launched, 
the  TACAIR  community  was  able  to  get  13%  more  aircraft  over 
target,  which  indicates  the  NON  TACAIR  community  suffered 
greater  losses  on  ingress  routes.  One  of  the  most  prominent 
differences  in  the  warfare  communities  appeared  in  the  number 
of  strike  packages  used  by  each.  The  Non-Tact i cal -Air 
community  tended  to  use  more  strike  packages  than  the  Tacair 
community,  and  the  analysis  indicates  that  as  a  player  used 
more  packages,  his  offensive  performance  tended  to  decrease. 

Overall,  as  the  level  of  information  increased,  the 
total  number  of  strike  aircraft  reaching  target  and  percentage 
of  strike  aircraft  reaching  target  both  increased,  however, 
the  increase  was  not  in  an  incremental  fashion  as  was 
anticipated  prior  to  the  experiment.  Generally  the  first  three 
levels  exhibited  an  increase,  however,  the  results  of  the 
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highest  level  of  Information  dropped  off  slightly.  As 
previously  discussed,  the  authors  are  unable  to  explain 
exactly  why  this  occurred,  but  suspect  that  the  players  might 
have  experienced  "Information  overload",  in  which  too  much 
Information  was  supplied  to  the  commander  during  the  game,  and 
the  players  were  unable  to  maintain  the  proper  situational 
awareness.  From  direct  observation  during  the  simulation 
runs,  the  authors  did  notice  that  it  seemed  as  if  players  in 
the  highest  information  level  did  encounter  "information 
overload"  at  approximately  the  same  point  in  the  simulation, 
due  to  the  length  of  the  information  update  messages. 

Information  flow  to  the  commander  also  influenced  the 
number  of  strike  packages  used  by  the  player.  As  the  level  of 
information  to  the  commander  increased,  he  tended  to  use  fewer 
strike  packages.  This  trend  appeared  in  both  communities,  but 
was  more  predominant  in  the  Non-Tactical-Air  community. 
Players  who  were  given  a  lower  level  of  information  tended  to 
use  more  packages.  The  authors  suspect  the  extra  packages  were 
possibly  used  to  counter  unknown  threats  that  the  players  were 
unsure  about  due  to  the  poorer  levels  of  information  provided 
them.  With  a  higher  level  of  information  flow  to  the 
commander,  it  appears  that  assets  were  used  more  effectively 
in  accomplishing  the  mission.  This  in  essence  is  an  example 
of  information  systems  acting  as  a  force  multiplier  for  the 
commander.  The  commander  was  able  to  achieve  better  results 
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(In  this  case,  more  ordnance  on  target),  with  a  given  set  of 
forces,  when  his  level  of  information  flow  was  increased. 

2 .  Defensive  Performance 

Defensive  results  differed  from  those  anticipated 
prior  to  the  experiment.  Analysis  indicates  that  neither 
warfare  community  was  able  to  achieve  a  better  defensive 
posture  against  a  formidable  threat  to  the  CVBG  in  the  RESA 
simulation.  Both  communities  were  able  to  attrite  about  the 
same  number  of  Orange  attack  aircraft  prior  to  the  release  of 
their  weapons. 

Information  level  also  tended  to  not  affect  the 
players'  defensive  results.  Mo  specific  trends  are  apparent 
in  the  mean  number  of  Orange  attack  aircraft  attrited  prior  to 
weapon  launch.  This  result  was  also  different  from  what  the 
authors  had  anticipated  prior  to  the  experiment,  so  further 
analysis  was  performed  to  exeuoine  possible  reasons  for  no 
difference  in  defensive  results  based  on  four  information 
levels. 

Analysis  indicates  that  the  number  of  fighter  aircraft 
actually  launched  as  CAP  aircraft  had  no  effect  on  the  number 
of  Orange  attack  aircraft  actually  destroyed  prior  to  the 
launch  of  weapons.  Players  that  launched  24  CAP  aircraft  shot 
down  the  same  number  of  Orange  attackers  as  those  that  only 
launched  eight  CAP  aircraft  in  some  instances.  The  deciding 
factor  in  determining  defensive  results  was  how  well  the 
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aircraft  were  controlled  after  they  were  airborne,  not  just 
total  nuBbers  of  aircraft.  During  this  phase  of  the  game  the 
player  was  involved  offensively  in  ensuring  the  strike 
packages  encountered  the  minimum  threat  as  well  as  maintaining 
a  proper  defensive  posture.  Those  players  with  excessive  CAP 
aircraft  airborne  were  sometimes  unable  to  maintain  the 
tactical  picture  because  of  "information  overload"  and  control 
of  the  airborne  forces  was  adversely  affected.  The  players 
had  the  forces  required  to  accomplish  the  mission,  but  were 
unable  to  correctly  make  tactical  decisions  fast  enough  to 
counter  the  threat. 

In  summary,  defensive  capabilities  did  not  seem  to  be 
affected  by  warfare  community  or  information  flow  to  the 
commander.  The  manner  in  which  those  forces  were  controlled 
once  they  were  airborne  could  have  been  the  primary  reason  for 
the  results.  In  addition,  since  this  simulation  involved  a 
man-in-the-lcop,  this  could  have  been  caused  by  variance 
between  the  players  or  other  factors  such  as  how  the  ROE  were 
interpreted  or  the  actual  way  the  scenario  was  designed. 

This  type  of  experiment  also  identifies  problems 
associated  with  the  man-in-the-loop  decision  model  for  testing 
and  experimental  purposes.  It  does  include  a  high  degree  of 
realism  since  human  players  are  actually  making  the  decisions; 
however,  it  also  increases  the  cost  and  the  duration  of  the 
simulation  runs.  In  addition,  the  use  of  human  players  inserts 
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a  high  variance  stochastic  element  into  a  simulation  which 
might  otherwise  be  deterministic.  (Hartman,  1992,  pl6) 

It  is  important  to  emphasize  that  this  type  of 
experiment  does  not  provide  a  complete,  all  encompassing 
answer  to  a  research  question.  If  one  were  conducting  tests  of 
two  systems  to  determine  which  performed  better  than  the 
other,  a  simulation  without  the  man-in-the-loop  element  should 
be  used. 

C.  REOOmiEIIDATIOilS 

Continued  research  in  this  area  is  highly  recommended  to 
further  analyze  some  of  the  questions  raised  by  this 
experiment.  The  RESA  simulation  provides  an  excellent  tool 
for  researching  various  aspects  of  command  and  control  issues. 
Other  topics  of  possible  interest  are  the  "information 
overload  "  concept  in  a  wargame  as  well  as  questions  posed  by 
the  authors  in  the  previous  section. 
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VI.  LESSOMS  LEARNED 


A.  EXPERIMENTAL  DESIGN 

The  authors  found  the  entire  research  effort  to  be 
extrenely  challenging  in  several  respects.  The  nan- in-the- loop 
type  of  sinulation  is  difficult  because  one  must  solicit 
volunteer  participation  from  a  particular  group  of  individuals 
who  have  the  skills  required  for  the  experiment.  The  following 
list  includes  valuable  lessons  learned  during  the  early  phase 
of  man-in-the-loop  model  development,  when  the  actual  design 
of  the  model  was  being  developed.  The  authors  provide  the 
following  guidelines: 


1.  Limit  the  ntimber  of  factors  for  which  the  effects  are 
being  measured,  as  well  as  the  different  levels  of  those 
factors.  In  this  experiment,  the  two  factors  examined  were 
information  flow  (four  levels)  and  warfare  specialty  (2 
levels).  This  allowed  only  three  samples  of  each  particular 
configuration,  which  introduced  excessive  amounts  of 
variation  due  to  the  small  sample  size.  Larger  cell  counts 
are  recommended  if  enough  players  are  able  to  participate. 


2 .  The  procedure  of  having  each  participant  play  one 
scenario  only  one  time  prevented  any  learning  curve  effect. 
The  authors  did  consider  several  options,  such  as  having  one 
player  play  one  scenario  at  different  levels  of  information, 
but  decided  against  any  plan  that  involved  a  learning  curve 
effect.  Having  different  versions  of  one  scenario  and  having 
each  player  participate  one  time  did  prevent  any  learning 
curve  effect;  however,  it  did  require  more  participants  than 
any  of  the  other  methods. 

3.  Decide  on  measures  of  effectiveness  early  in  the 
experimental  development.  This  will  help  determine  what  type 
of  data  analysis  will  be  conducted  after  the  collection  of 
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all  data.  Deciding  on  MOES  early  also  prevents  eisdirected 
tiae  and  efforts  in  recording  non-essential  data. 


B.  DATA  COLLECTION  PHASE 

The  following  list  contains  lessons  learned  during  the 
actual  simulation  runs  as  well  as  early  practice  runs  of  the 
scenario . 


1.  Limit  the  scope  of  the  simulation  to  achieve  a  reasonable 
aeueimua  time  required  for  completion  of  a  single  run. 

2.  Ensure  all  assistance  from  lab  technicians  is  briefed  in 
detail  so  all  personnel  understand  exactly  what  their  duties 
are  so  each  run  is  conducted  in  exactly  the  same  manner 
every  time. 

3 .  Be  prepared  for  players  to  ask  almost  any  type  of 
question  and  for  the  players  to  use  several  different  ways 
to  perform  a  mission.  All  tactical  possibilities  must  be 
considered  in  the  planning  phase  of  the  scenario. 

4.  Player  briefs  must  be  well  structured,  organized,  and 
most  important  of  all,  brief  and  concise. 

5.  Proper  coordination  with  the  Lab  Manager  is  crucial  for 
generating  script  files,  scheduling  lab  time  for  the 
simulation  runs,  and  ensuring  that  proper  procedures  were 
followed  during  the  simulation. 


APPENDIX  A:  SIMULATION  PARTICIPANTS 

1.  LT  Jeffrey  Carlson,  USN,  SH-6B  Pilot 

2.  LCDR  Kevin  Crawford,  USN,  F-14  NFO 

3.  LT  Jack  Davis,  USN,  Surface  Warfare 

4.  CDR  Robert  Ellis,  USN,  P-3C  NFO 

5.  LT  Gary  Formet,  USN,  F-14  NFO 

6.  LCDR  Charles  Fuller,  USN,  SH-60B  Pilot 

7.  LT  Jeff  Gregoire,  USN,  A-6E  NFO 

8.  LT  Christopher  Halton,  USN,  Surface  Warfare 

9.  LT  Thomas  Halverson,  USN,  Surface  Warfare 

10.  CDR  Thomas  Hoskins,  USN,  Surface  Warfare 

11.  LT  Donald  Johnson,  USN,  SH-60B  Pilot 

12.  LT  Daniel  Knaus,  USN,  E-2C  NFO 

13.  LT  Robert  Laubengayer,  USN,  CH-46  Pilot 

14.  LT  John  Manser,  USN,  F-14  NFO 

15.  LT  Michael  McFerren,  USN,  E-2C  NFO 

16.  LT  Kurt  Meisenheimer ,  USN,  P-3C  NFO 

17.  CDR  Steven  Meyers,  USN,  E-2C  NFO 

18.  LT  Charles  Minter,  USN,  EA-6B  NFO 

19.  LT  Michael  Moats,  USN,  E-2C  NFO 

20.  LT  David  Rymer,  USN,  SH-60B  Pilot 

21.  LCDR  James  Stewart,  USN,  P-3C  NFO 

22.  LT  Steven  Tackett,  USN,  EA-6B  NFO 
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23.  CDR  Stephen  Walker,  USN,  F-14  NFO 

24.  LT  Donald  Zwick,  USN,  EA-6B  NFO 
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Appendix  B:  Basic  Experimental  Results 


Con  Col2  Col3  Com  CoI5  CoI6  CoI7 

War  Spec  Level  Stk  Pack  Sup  Pack  EA6B  Eff  Stk  Inch  Esc  Lnch 


1 

0 

2 

1 

1 

16 

12 

0 

0 

1 

1 

1 

24 

8 

0 

1 

1 

0 

1 

20 

14 

1 

1 

3 

0 

0 

28 

10 

0 

0 

2 

2 

0 

12 

20 

0 

2 

1 

2 

1 

24 

22 

1 

0 

2 

1 

0 

16 

4 

1 

2 

1 

1 

1 

28 

8 

1 

2 

2 

0 

0 

18 

24 

0 

2 

1 

1 

1 

34 

8 

1 

3 

2 

0 

0 

28 

13 

1 

1 

2 

0 

1 

24 

8 

1 

0 

2 

0 

0 

24 

16 

1 

1 

2 

1 

0 

26 

8 

0 

3 

1 

2 

1 

12 

12 

1 

3 

2 

0 

1 

22 

14 

0 

1 

2 

0 

1 

32 

0 

1 

2 

2 

0 

1 

28 

8 

0 

3 

2 

2 

1 

24 

16 

1 

3 

1 

2 

1 

28 

10 

0 

2 

1 

2 

1 

8 

4 

0 

0 

2 

1 

1 

24 

8 

0 

3 

2 

2 

0 

16 

16 

0 

1 

2 

0 

0 

16 

16 

LEGEND 


jWaz  Spec: 
!  Level 

i 

Istk  Pack: 
Sup  Pack: 
EA6B  Eff: 
'stk  Lnch: 

I 

' Esc  Lnch: 


Warfare  Specialty;  TACAIR  »  0,  NON-TACAIR  -  1 

Infomation  Level;  Very  Low  =  0,  Low  ^  1,  Medium  =  2, 
High  »  3 

Number  of  Strike  Packages  launched 

Number  of  Strike  Support  Packages  launched 

EA-6B  effectiveness;  Utilized  »  1,  Not  Utilized  =  0 

Number  of  Strike  aircraft  launched 

Number  of  Escort  aircraft  launched 


EACH  ROW  IS  DATA  FROM  ONE  PLAYER  /  ONE  MODEL  RUN 


I 
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Appendix  B;  Basic  Experimental  Results 


Col8  Col9  C0IIO  Colli  Coi12  Col13  Col14 

SSup  Int  SSup  Ext  StkLostI  EscLostI  SSpLostI  StkLostE  EscLostE 

2  4  3  3  1  5  7 

0  7  0  2  1  7  6 

5  0  0  0  0  10  14 

4  0  16  6  2  1  0 

0  10  3  7  7  4  4 

2  6  1  0  0  0 

4  9  12  2  12  4 

2  3  0  1  0  4 

6  0  3  11  0  4 

1  6  0  0  0  11 

2  0  10  7  2  8 

4  0  4  2  1  1  1 

4  0  3  12  2  3  1 

4  8  7  0  9  7  7 

0  6  1  2  0  11  9 

4  0  2  0  0  7  4 

1  0  1  0  1  14  0 

5  0  1  1  1  11  4 

0  6  1  1  0  10  7 

2  4  7  1  0  15  7 

0  10  0  0  9  0  3 

2  10  3  7  2  6  0 

1  6  5  14  4  7  1 

2  0  8  9  1  3  2 


j LEGEND 


SSup  Int;  Number  of  Strike  Support  aircraft  launched  that  were 
internal  to  the  Strike  Package. 

!  SSup  Ext:  Number  of  Strike  Support  aircraft  launched  that  were 
I  external  to  the  Strike  Package. 

I StkLostI :  Nusdjer  of  Strike  aircraft  lost  during  ingress . 

I 

EcsLostI:  Number  of  Escort  aircraft  lost  during  ingress. 

I 

i  SSpLostI:  Number  of  Strike  Support  aircraft  lost  during  ingress. 

StkLostE:  Nuniber  of  Strike  aircraft  lost  during  egress. 

i 

EscLostE;  Number  of  Escort  aircraft  lost  during  egress. 

'each  RON  IS  DATA  FROM  ONE  PLATER  /  ONE  MODEL  RUN 


I 
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Appendix  B:  Basic  Experimental  Results 

Col15  C0II6  C0II7  C0II8  C0II9  C0I20  C0I21 

SSpLostE  NKLnchl  NKLnchE  NKLostI  NKLostE  CAP  Lnch  CSupLnch 


1 

33 

0 

8 

2 

8 

5 

1 

0 

33 

0 

5 

16 

9 

3 

0 

33 

0 

0 

14 

8 

1 

42 

0 

40 

0 

14 

14 

0 

42 

0 

17 

3 

10 

9 

4 

0 

15 

0 

9 

8 

10 

0 

72 

0 

16 

0 

10 

11 

5 

0 

38 

0 

15 

20 

9 

0 

24 

0 

18 

6 

14 

11 

7 

0 

33 

0 

8 

10 

9 

0 

18 

0 

0 

5 

12 

3 

0 

23 

0 

12 

7 

12 

12 

2 

47 

0 

32 

1 

8 

4 

3 

24 

0 

3 

0 

20 

8 

6 

0 

33 

0 

0 

20 

8 

2 

0 

33 

0 

1 

12 

10 

0 

0 

33 

0 

14 

12 

5 

2 

0 

33 

0 

6 

20 

9 

2 

0 

33 

0 

4 

8 

10 

2 

5 

18 

0 

8 

16 

10 

0 

5 

42 

2 

17 

14 

7 

5 

38 

0 

8 

13 

14 

8 

1 

38 

0 

10 

0 

17 

10 

0 

33 

0 

9 

5 

24 

12 

LEGEND 

SSpLostE:  Number 

of 

strike 

Support  aircraft  lost 

during 

egress . 

i 

1 

NKLnchl  :  Number 

of 

Orange 

aircraft 

launched  during  Blue 

ingress. 

1 

NKLnchE  :  Number 

of 

Orange 

aircraft 

launched  during  Blue 

egress . 

i 

1 

NKLostI  :  Number 

of 

Orange 

aircraft 

lost  during  Blue 

ingress 

• 

NKLostE  :  Number 

of 

Orange 

aircraft 

lost  during 

Blue 

egress . 

CAP  Zjich:  Nundser  of  CAP  aircraft  launched. 


CSupLnch:  Nunber  of  CAP  Support  aircraft  launched. 
EACH  ROW  IS  DATA  FRCM  ONE  PLAYER  /  ONE  MODEL  RUN 
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Appendix  Q:  Basic  Experimental  Results 


C0I22 

C0I23 

C0I24 

C0I2S 

Col26  Col27 

Col28 

CAPLost 

CSupLost 

BadLost 

ASS  Lnch 

BEscLost  etc  ID 

BlueLnch 

4 

0 

7 

10 

8 

8 

47 

5 

0 

12 

6 

12 

3 

64 

8 

0 

13 

7 

9 

11 

61 

6 

0 

10 

5 

12 

8 

70 

4 

0 

10 

5 

10 

10 

61 

0 

0 

15 

0 

12 

7 

72 

9 

4 

14 

2 

9 

9 

54 

11 

0 

10 

9 

7 

8 

70 

10 

4 

10 

11 

5 

5 

73 

5 

0 

9 

10 

6 

6 

68 

8 

0 

12 

4 

8 

8 

58 

3 

0 

15 

5 

12 

10 

60 

7 
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10 

5 

0 

11 

56 

8 

3 

9 

3 

7 

11 

74 

13 

1 

11 

5 

6 

7 

58 

7 

2 

8 

7 

8 

9 

62 

3 

0 

15 

9 

10 

11 

50 

14 

3 

15 

1 

12 

10 

70 

8 

1 

10 

5 

10 

10 

64 

8 

0 

14 

6 

8 

8 

70 

8 

1 

10 

6 

9 

10 

43 

5 

1 

14 

7 

7 

11 

66 

6 

2 

12 

4 

8 

9 

66 

13 

1 

14 

5 

8 

10 

70 

LEGEND 

I 

;  CAPLost  :  Number  of  CAP  aircraft  lost- 

I 

CSupLost:  Number  of  CAP  Support  aircraft  lost. 

I BadLost  :  Number  of  Orange  Badger  aircraft  lost. 

,AS5  Lnch:  Number  of  Orange  Badger  aircraft  lost  prior  to  reaching 
Weapon  Release  Point. 

BEscLost:  Number  of  Orange  Badger  Escort  aircraft  lost, 
etc  ID  :  Number  of  unknown  contacts  identified. 
iBlueLnch:  Total  number  of  Blue  aircraft  launched. 

EACH  ROW  IS  DATA  FROM  ONE  PLAYER  /  ONE  MODEL  RUN 


73 


Appendix  B;  Basic  Experimental  Results 


Col29  Coi30  Col31  Col32  Col33 

BlueLost  NKLnch  NKLost  Aircraft  SAM 


24 

60 

25 

NA 

22 

60 

29 

4 

35 

60 

22 

1 

32 

69 

62 

2 

29 

69 

40 

2 

10 

42 

36 

2 

43 

99 

39 

1 

27 

65 

32 

1 

32 

51 

39 

1 

31 

60 

23 

3 

37 

45 

25 

2 

12 

50 

46 

3 

30 

74 

43 

NA 

44 

51 

19 

1 

43 

60 

17 

2 

24 

60 

17 

1 

19 

60 

39 

3 

37 

60 

33 

3 

30 

60 

24 

3 

40 

50 

30 

4 

21 

74 

38 

3 

29 

65 

42 

2 

40 

65 

30 

2 

37 

60 

36 

2 

.  LEGEND 


'BlueLost:  Total  number  of  Blue  aircraft  lost. 

NKLnch  :  Total  number  of  Orange  aircraft  launched. 

NKLost  :  Total  number  of  Orange  aircraft  lost. 

'Aircraft:  Player  ranking  of  aircraft  data  inqportance. 

SAM  :  Player  ranking  of  SAM  data  importance. 

! Logistic:  Player  ranking  of  logistic  data  importance. 

;  OP  Comm  :  Player  ranking  of  operation  communication  data  importance. 
EACH  RON  IS  DATA  FROM  ONE  PLAYER  /  ONE  MODEL  RUN 
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Appendix  B;  Basic  Experimental  Results 


Col36 

Col37 

Coi38  Col39 

Air  Surv 

Def  Stgy 

NTA  a/c  TA  a/c 

NA 

NA 

NA 

3 

1 

2 

3 

4 

1 

1 

6 

1 

1 

5 

1 

3 

5 

2 

3 

6 

3 

2 

6 

NA 

3 

4 

1 

1 

4 

1 

1 

3 

3 

4 

1 

4 

NA 

NA 

2 

6 

3 

4 

2 

4 

2 

4 

1 

2 

1 

4 

2 

3 

1 

2 

4 

3 

1 

4 

3 

6 

4 

1 

2 

2 

3 

2 

3 

3 

3 

2 

2 

2 


Col40  Col41 
NTASAM  TASAM 
NA 
3 
2 
3 
2 
6 
2 
NA 
3 

3 

4 
1 


2 

2 

3 
1 
2 
1 
1 
2 

4 
1 
3 
1 


Col42 

NTALOG 

NA 

5 

5 

5 

5 

5 

6 
NA 

5 

5 

5 

6 


I  LEGEND 


I  Air  Surv: 
■  Def  Stgy: 

InTA  a/c  : 

I 

'TA  a/C  : 
;NTA  SAM  : 
TA  SAM  ; 
;VTA  LOG  : 


Flayer  ranking  of  radar  data  importance. 

Flayer  ranking  of  Orange  defensive  strategy  data  in^ortance. 
NON-TACAIR  player  ranking  of  aircraft  data  importance. 
TACAIR  player  ranking  of  aircraft  data  iinportance. 
NON-TACAIR  player  ranking  of  SAM  data  importance. 

TACAIR  player  ranking  of  SAM  data  importance. 

NON-TACAIR  player  ranking  of  logistic  data  inportance. 


'each  row  is  data  FROM  ONE  FLAYER  /  ONE  MODEL  RUN 
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Appendix  B;  Basic  Experimental  Results 


Col43  COI44  Col45  Col46  Col47  Col48  Col49 
TALOG  NTACOMW  TACOMM  NTASufV  TASufv  NTAStgy  TAStgy 


6 

NA 

5 

NA 

3 

NA 

6 

4 

5 

1 

3 

6 

6 

4 

4 

3 

1 

6 

4 

4 

6 

2 

3 

6 

6 

6 

5 

3 

1 

4 

6 

4 

5 

1 

3 

3 

6 

5 

5 

4 

2 

1 

6 

NA 

5 

NA 

1 

NA 

6 

4 

5 

2 

1 

6 

5 

6 

6 

2 

4 

4 

5 

6 

6 

1 

1 

2 

4 

5 

5 

2 

3 

3 

LEGEND 


TA  LOG  :  TACAIR  player  ranking  of  logistic  data  importance. 

'  NTA  COMM;  NON-TACAIR  player  ranking  of  operational  coonunication 
data  inportance. 

TA  COHM  :  TACAIR  player  ranking  of  operational  communication  data 
isportance . 

NTA  Surv:  NON-TACAIR  player  ranking  of  radar  data  inportance. 

TA  Surv  :  TACAIR  player  ranking  of  radar  data  importance. 

NTA  Stgy:  NON-TACAIR  player  ranking  of  Orange  defensive  strategy 
data  importance. 

TA  Stgy  :  TACAIR  player  ranking  of  Orange  defensive  strategy  data 
importance. 

EACH  RON  IS  DATA  FROH  ONE  PLAYER  /  ONE  MODEL  RUN 
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Appendix  C;  Analysis  Data 


Con 

War  Spec 

1 

0 

0 

1 

0 

0 

1 

1 

1 

0 

1 

1 

1 

1 

0 

1 

0 

1 

0 

1 

0 

0 

0 

0 


Col2 

Level 

0 

0 

1 

1 

0 

2 

0 

2 

2 

2 

3 

1 

0 

1 

3 

3 

1 

2 

3 

3 

2 

0 

3 

1 


Col3 
Stk  Pack 

2 
1 
1 
3 
2 
1 
2 
1 
2 
1 
2 
2 
2 
2 
1 
2 
2 
2 
2 
1 
1 
2 
2 
2 


Col4 

StkTGT 

13 
24 
20 
12 
9 
23 
4 
28 
15 
34 
18 
20 
21 

19 
11 

20 
31 
27 
23 
21 

8 
21 
11 
8 


Col5 

%StkTGT 
0.8125 
1 
1 

0.428571 
0.75 
0.958333 
0.25 
1 

0.833333 
1 

0.642857 
0.833333 
0.875 
0.730769 
0.916667 
0.909091 
0.96875 
0.964286 
0.958333 
0.75 
1 

0.875 
0.6875 
0.5 


Coi6 

CAP  Inch 
8 
16 
14 
14 
10 
8 
10 
20 
14 
10 
12 
12 
8 
20 
20 
12 
12 
20 
8 
16 
14 
14 
17 
24 


Col7 

BAD  Lost 
10 
6 
7 
5 
5 
0 
2 
9 
11 
10 

4 

5 
5 

3 
5 
7 
9 
1 

5 

6 
6 
7 

4 

5 


Col8 
etc  ID 

8 

3 

11 

8 

10 

7 
9 

8 

5 

6 
8 

10 

11 

11 

7 
9 

11 

10 

10 

8 
10 
11 

9 

10 


LEGEND 

i 

War  Spec:  Warfare  Specialty;  TACAIR  ■  0,  NON-TACAIR  -  1. 

! Level  :  Information  Level;  Very  Low  =  0,  Low  -  1,  Medium  *  2, 

High  «  3. 

;Stk  Pack:  Number  of  Strike  Packages  launched. 

iStk  TGT  :  Number  of  Strike  aircraft  reaching  target. 

%Stk  TGT:  Percentage  of  Strike  aircraft  reaching  target. 

CAP  Lnch:  Number  of  CAP  aircraft  launched. 

BAD  Lost:  Number  of  Orange  Badger  aircraft  lost  prior  to  launching  weapons. 
;  etc  ID  :  Number  of  unknown  contacts  identified. 
iEACH  ROW  IS  DATA  FROM  ONE  PLAYER  /  ONE  MODEL  RUN 

i 

I 
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Appendix  C;  Analysis  Data 


Col1  Col2  Col3  Col4  ColS  Col6  Col7  Col8 

War  Spec  Level  StkPack  StkTGT  %StkTGT  CAPLnch  BAD  Lost  CtcIO 


0 

0 

1 

24 

1 

16 

6 

3 

0 

1 

1 

20 

1 

14 

7 

11 

0 

0 

2 

9 

0.75 

10 

5 

10 

0 

2 

1 

23 

0.958333 

8 

0 

7 

0 

2 

1 

34 

1 

10 

10 

6 

0 

3 

1 

11 

0.916667 

20 

5 

7 

0 

1 

2 

31 

0.96875 

12 

9 

11 

0 

3 

2 

23 

0.958333 

8 

5 

10 

0 

2 

1 

8 

1 

14 

6 

10 

0 

0 

2 

21 

0.875 

14 

7 

11 

0 

3 

2 

11 

0.6875 

17 

4 

9 

0 

1 

2 

8 

0.5 

24 

5 

10 

LEGEND 

I  War  Spec:  Warfare  Specialty;  TACAIR.  | 

(Level  :  Information  Level;  Very  Low  -  0,  Low  «  1,  Medium  «  2,  High  =  3. 

Stk  Pack:  Number  of  Strike  Packages  launched.  i 

Stk  TGT  :  Number  of  Strike  aircraft  reaching  target. 

I  %Stk  TGT:  Percentage  of  Strike  aircraft  reaching  target. 

I  CAP  Lnch:  Number  of  CAP  aircraft  launched. 

I  BAD  Lost:  Number  of  Orange  Badger  aircraft  lost  prior  to  launching  weapons, 
'etc  ID  :  Number  of  unknown  contacts  identified. 

EACH  ROW  IS  DATA  FROM  ONE  PLAYER  /  ONE  MODEL  RUN 
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Appendix  C;  Analysis  Data 


Coil  Col2  Col3  Col4  ColS  Col6  Col7  Col8 

War  Spec  Level  StkPack  StkTGT  %StkTGT  CAPLnch  BAD  Lost  CtcID 


1 

0 

2 

13 

0.8125 

8 

10 

8 

1 

1 

3 

12 

0.428571 

14 

5 

8 

1 

0 

2 

4 

0.25 

10 

2 

9 

1 

2 

1 

28 

1 

20 

9 

8 

1 

2 

2 

15 

0.833333 

14 

11 

5 

1 

3 

2 

18 

0.642857 

12 

4 

8 

1 

1 

2 

20 

0.833333 

12 

5 

10 

1 

0 

2 

21 

0.875 

8 

5 

11 

1 

1 

2 

19 

0.730769 

20 

3 

11 

1 

3 

2 

20 

0.909091 

12 

7 

9 

1 

2 

2 

27 

0.964286 

20 

1 

10 

1 

3 

1 

21 

0.75 

16 

6 

8 

j  LEGEND 

I  War  Spec:  Warfare  Specialty;  NON-TACAIR. 

!  Level  :  Information  Level;  Very  Low  -  0,  Low  =  1,  Medium  «  2,  High  =  3. 
Stk  Pack:  Number  of  Strike  Packages  launched, 
j Stk  TGT  :  Number  of  Strike  aircraft  reaching  target. 

.  %Stk  TGT:  Percentage  of  Strike  aircraft  reaching  target. 

ICAP  Lnch:  Number  of  CAP  aircraft  launched. 

!bAD  Lost:  Number  of  Orange  Badger  aircraft  lost  prior  to  launching  weapons, 
etc  ID  :  Number  of  unknown  contacts  identified. 

'EACH  ROW  IS  DATA  PROM  ONE  PLAYER  /  ONE  MODEL  RUN 


Appendix  C:  Analysis  Data 


Com  CoI2  CoI3  CoI4  CoI5  CoI6  CoI7  CoI8 

War  Spec  Level  StkPack  StkTGT  %StkTGT  CAPLnch  BAD  Lost  CtcID 


1 

0 

2 

13 

0.8125 

8 

10 

8 

0 

0 

1 

24 

1 

16 

6 

3 

0 

0 

1 

20 

1 

14 

7 

11 

1 

0 

3 

12 

0.428571 

14 

5 

8 

0 

0 

2 

9 

0.75 

10 

5 

10 

0 

1 

1 

23 

0.958333 

8 

0 

7 

1 

0 

2 

4 

0.25 

10 

2 

9 

1 

1 

1 

28 

1 

20 

9 

8 

1 

1 

2 

15 

0.833333 

14 

11 

5 

0 

1 

1 

34 

1 

10 

10 

6 

1 

1 

2 

18 

0.642857 

12 

4 

8 

1 

0 

2 

20 

0.833333 

12 

5 

10 

1 

0 

2 

21 

0.875 

8 

5 

11 

1 

0 

2 

19 

0.730769 

20 

3 

11 

0 

1 

1 

11 

0.916667 

20 

5 

7 

1 

1 

2 

20 

0.909091 

12 

7 

9 

0 

0 

2 

31 

0.96875 

12 

9 

11 

1 

1 

2 

27 

0.964286 

20 

1 

10 

0 

1 

2 

23 

0.958333 

8 

5 

10 

1 

1 

1 

21 

0.75 

16 

6 

8 

0 

1 

1 

8 

1 

14 

6 

10 

0 

0 

2 

21 

0.875 

14 

7 

11 

0 

1 

2 

11 

0.6875 

17 

4 

9 

0 

0 

2 

8 

0.5 

24 

5 

10 

. LEGEND 

i 

;War  Spec:  Warfare  Specialty;  TbcAIR  «  0,  NON-TACAIR  »  1. 

Level  :  Information  Level;  Low  -  0,  High  “  1- 
Stk  Pack:  Number  of  Strike  Packages  launched. 

Stk  TGT  :  Number  of  Strike  aircraft  reaching  target. 

?Stk  TGT:  Percentage  of  Strike  aircraft  reaching  target. 

CAP  Lnch:  Number  of  CAP  aircraft  launched. 

BAD  Lost:  Number  of  Orange  Badger  aircraft  lost  prior  to  launching  weapons, 
etc  ID  :  Number  of  unknown  contacts  identified. 

EACH  ROW  IS  DATA  FROM  ONE  PLAYER  /  ONE  MODEL  RUN 


! 
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Appendix  C;  Analysis  Data 


Coll  Col2  Col3  Col4  Col5  Col6  Col7  Col8 

Wv  Spec  Level  Stk  Pack  Stk  TGT  %Stk  TGT  CAP  Lnch  BAD  Lost  Ctc  ID 


0 

0 

1 

24 

1 

16 

6 

0 

0 

1 

20 

1 

14 

7 

0 

0 

2 

9 

0.75 

10 

5 

0 

1 

1 

23 

0.958333 

8 

0 

0 

1 

1 

34 

1 

10 

10 

0 

1 

1 

11 

0.916667 

20 

5 

0 

0 

2 

31 

0.96875 

12 

9 

0 

1 

2 

23 

0.958333 

8 

5 

0 

1 

1 

8 

1 

14 

6 

0 

0 

2 

21 

0.875 

14 

7 

0 

1 

2 

11 

0.6875 

17 

4 

0 

2 

8 

0.5 

24 

5 

LEGEND 


War  Spec: 
Level  : 
Stk  Pack: 
Stk  TGT  : 
%Stk  TGT: 
CAP  Lnch: 


Warfare  Specialty;  TACAIR. 

Information  Level;  Low  -  0,  High  *  1. 

Number  of  Strike  Packages  launched. 

Number  of  Strike  aircraft  reaching  target. 
Percentage  of  Strike  aircraft  reaching  target. 
Number  of  CAP  aircraft  launched. 


BAD  Lost:  Number  of  Orange  Badger  aircraft  lost  prior  to  launching  weapons, 
etc  ID  :  Number  of  unknown  contacts  identified. 

EACH  ROW  IS  DATA  FROM  ONE  PLAYER  /  ONE  MODEL  RUN 


Appendix  C;  Analysis  Data 


Coil  Col2  Col3  Col4  CoiS  Coi6  Col7  Col8 

War  Spec  Level  StkPack  StkTGT  %StkTGT  CAPLnch  BAD  Lost  CtcID 


1 

0 

2 

13 

0.8125 

8 

10 

8 

1 

0 

3 

12 

0.428571 

14 

5 

8 

1 

0 

2 

4 

0.25 

10 

2 

9 

1 

1 

1 

28 

1 

20 

9 

8 

1 

1 

2 

15 

0.833333 

14 

11 

5 

1 

1 

2 

18 

0.642857 

12 

4 

8 

1 

0 

2 

20 

0.833333 

12 

5 

10 

1 

0 

2 

21 

0.875 

8 

5 

11 

1 

0 

2 

19 

0.730769 

20 

3 

11 

1 

1 

2 

20 

0.909091 

12 

7 

9 

1 

1 

2 

27 

0.964286 

20 

1 

10 

1 

1 

1 

21 

0.75 

16 

6 

8 

!  LEGEND  I 

!  I 

jWar  Spec:  Warfare  Specialty;  NON-TACAIR.  j 

I  Level  :  Information  Level;  Low  -  0,  High  -  1.  j 

iStk  Pack:  Number  of  Strike  Packages  launched.  i 

,Stk  TGT  :  Nundser  of  Strike  aircraft  reaching  target.  | 

> IStk  TGT:  Percentage  of  Strike  aircraft  reaching  target.  j 

I  CAP  Lnch:  Number  of  CAP  aircraft  launched.  j 

I  BAD  Lost:  Number  of  Orange  Badger  aircraft  lost  prior  to  launching  weapons.  I 

i  etc  ID  :  Number  of  unknown  contacts  identified. 

'each  row  is  data  from  one  player  /  ONE  MODEL  RUN 

I 

i  I 

‘  i 

I  I 

i  t 
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APPENDIX 


PLAYER  DISTRIBUTION 


APPENDIX  E:  INTELLIGENCE  BRIEFS 


A.  INITIAL  INTELLIGENCE  BRIEF  (ALL  PLAYERS) 

1 .  Background 
a.  Navy 

The  North  Korean  Navy  is  largely  a  coastal  defense 
force  consisting  mostly  of  small  patrol  craft,  missile  attack 
boats,  corvettes,  amphibious  craft  and  mine  warfare  units. 
Although  these  units  do  not  possess  a  sustained  blue  water 
operational  capability,  some  units  have  been  observed 
operating  a  significant  distance  from  the  coast  for  limited 
amounts  of  time  during  increased  tensions  and  crises.  These 
platforms  do  not  pose  a  serious  threat  to  an  aircraft  carrier 
battlegroup;  however,  vigilance  is  recommended. 

The  Naval  organization  is  comprised  of  two  fleets; 
East  and  Nest.  The  East  Coast  Fleet  has  its  headquarters  at 
Toe  jo  Dong  with  major  bases  at  Najin  and  Nonson.  The  West 
Coast  Fleet  is  headquartered  at  Nampo  with  major  bases  at  Pipa 
Got  and  Sagon  Ni.  Minor  bases  are  established  in  various 
locations  along  both  coasts. 

The  Navy's  most  capable  surface  threat  to  a 
carrier  battlegroup  is  the  guided-missile  patrol  boats;  these 
are  versions  of  the  Soviet  designed  OSA-1  units.  They  are 
estimated  to  have  25  of  these  small  patrol  craft.  All  are 


84 


equipped  with  the  STYX  missile  launchers  and  carry  the  SS-N-2A 
anti'Ship  missile.  These  smaller  craft  usually  remain  within 
50  NM  of  the  North  Korean  coastline  to  police  territorial 
waters  but  have  been  observed  to  travel  out  further  into  the 
Sea  of  Japan  for  certain  exercises. 

b.  Air  Force 

The  North  Korean  Air  Force's  primary  mission  is 
defense  of  the  homeland.  This  is  accomplished  by  an  intricate 
air  defense  network  of  fighters,  surface~to-air  missile  (SAM) 
sites  and  anti-aircraft  artillery  sites.  Their  combat  aircraft 
inventory  consists  of  approximately  250  aircraft  of  the 
following  types:  Mig-19,  MiG-21,  Mig-23  and  MiG-29. 
Additionally,  they  possess  the  capability  to  perform  long 
range  tactical  air  strikes  with  their  newly  acquired  Badger 
aircraft  from  the  former  Soviet  Union.  They  are  estimated  to 
have  obtained  20  to  30  of  these  aircraft. 

c.  Air  Defense 

The  North  Korean's  approach  to  air  defense 
reflects  their  experiences  during  the  Korean  war; 
consequently,  much  effort  has  been  taken  to  repel  or  at  least 
reduce  the  damage  inflicted  to  its  industry  and  military 
installations  due  to  attacks  by  enemy  air  forces.  As  a  result, 
air  defense  is  a  top  priority.  The  air  defense  network  employs 
a  combination  of  antiaircraft  guns  with  SA-2,  SA-3,  SA-5  and 
SA-7  surface-to-air  missiles  to  provide  an  extremely  dense  air 
defense  network. 
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B.  VERY  LOW  LEVEL  INITIAL  INTELLIGENCE  BRIEF 

1 .  Defensive  Strategy 

Little  is  known  about  the  North  Korean  coBUDand  and 
control  structure;  however,  it  is  known  that  they  divide  the 
country  into  various  sectors  of  responsibility  with  a  control 
base  being  accountable  for  coordinating  the  use  of  SAM  sites 
and  fighter  aircraft  to  engage  attacking  aircraft.  Each  of  the 
below  discussed  air  bases  is  a  control  center  and  will  execute 
the  defensive  strategy  whenever  a  strike  penetra  ?s  their  area 
of  coverage.  MiG-19  and  MiG-21  aircraft  are  not  very  capable 
and  are  only  a  serious  threat  if  they  are  in  very  close 
proximity  to  a  potential  target.  Fortunately,  their  short 
range  weapons  and  short  combat  radius  limit  their  ability  to 
pursue  attacking  aircraft;  therefore,  these  aircraft  can 
easily  be  outrun  and  outmaneuvered .  The  MiG-23  and  MiG-29 
aircraft  are  far  more  capable.  They  have  longer  range 
missiles,  a  longer  combat  radius  and  greater  speed;  therefore, 
they  can  be  expected  to  aggressively  pursue  attacking 
aircraft. 

2.  Intelligence  Summary  Very  Low 
a.  Chong jin 

•  13  aircraft  counted  at  field  outside  hangars.  2  structures 
at  field  that  appear  to  be  hangers. 

•  SAM  radar  emissions;  type  and  quantities  unknown. 

•  Air-search  radars  present;  operating  parameters  and  range 
unkno«m . 
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Increased  message  traffic  between  Chong jin  and  Hamhung. 


Increased  logistic  support  vehicle  traffic;  contents 
unknown. 


b.  Songjin 

22  aircraft  counted  at  field  outside  hangars. 

4  hangars  located  at  field. 

SAM  radar  emissions;  type  and  quantity  unknown. 

Air-search  radars  present;  operating  parameters  and  range 
unknown . 

Routine  message  traffic  between  Songjin  and  Pyongyang. 

High  amount  of  message  traffic  between  Songjin  and 
unidentif ied  locations . 

Routine  logistic  support  vehicle  traffic. 

c.  Hamhung 

15  aircraft  counted  at  field  outside  hangers. 

5  primary  structures  at  field,  type  unknown.  SAM  radar 
emissions  -  type  and  quantity  unknown. 

Air-search  radars  present;  operating  parameters  and  range 
unkno%m . 

Increased  message  traffic  between  Hamhung,  Chong jin, 
Wonson  and  Pyongyang. 

Routine  logistic  support  vehicle  traffic. 

d.  Wonson 


9  aircraft  counted  at  field  outside  hangars. 

SAM  radar  status  unknown;  last  SAM  emissions  detected  10 
days  ago.  SAN  facilities  possibly  down. 
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•  Air-search  radars  present;  operating  parameters  and  range 
unknoim . 

•  Increased  message  traffic  between  Wonson  and  Hamhung; 
appears  to  be  operational  in  nature. 

•  Increased  logistic  support  vehicle  traffic;  contents 
unknown . 


e.  Pyongyang  *  Capital  City  * 

•  46  aircraft  counted  at  field  outside  hangars. 

•  Nvuaerous  large  structures  at  field,  type  unknown. 

•  Numerous  SAM  facilities  and  emissions;  type  and  guantity 
unknown . 

•  Numerous  air-search  radars  present;  operating  parameters 
and  range  unkno%m. 

•  Increased  message  traffic  between  Pyongyang,  Chong jin, 
Hamhung,  Wonson  and  Kanggye. 

«  Routine  logistic  support  vehicle  traffic. 

f.  Sinuiju 

•  25  aircraft  counted  at  field  outside  hangars. 

•  7  large  structures  at  field,  type  unknown. 

•  SAM  radar  emissions  present,  type  and  quantity  unknown. 

•  Air-search  radar  present,  operating  parameters  and  range 
unknown . 

•  Increased  message  traffic  between  Sinuiju  and  Kanggye. 

•  Routine  logistics  support  vehicle  traffic. 

g.  Kanggye  (TARGET) 

•  No  recent  information  as  of  this  date.  Most  likely  have 
sophisticated  air  defense  capability. 
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h.  R«BOte  SAM/AAA  Sites 

Nunerous  remote  SAM/AAA  sites  are  deployed 
throughout  the  country  to  help  defend  against  attack.  Usually 
they  are  deployed  in  defense  of  major  cities,  military  bases 
and  supply  routes.  Most  sites  are  along  the  coast;  however, 
some  are  located  inland. 

C.  LON  LEVEL  INITIAL  INTELLIGENCE  BRIEF 
1 .  Defensive  Strategy 

The  North  Koreans  utilize  a  coordinated  scheme  that 
combines  SAM  sites  and  fighter  aircraft  to  counter  air 
threats.  The  strategy  consists  of  dividing  the  country  into 
various  sectors  of  responsibility  with  a  control  base  being 
accountable  for  coordinating  the  use  of  SAM  sites  and  fighter 
aircraft  to  engage  attacking  aircraft.  MiG-19  and  MiG-21 
aircraft  are  not  very  capable  and  are  only  a  serious  threat  if 
they  are  in  very  close  proximity  to  a  potential  target. 
Fortunately,  their  short  range  weapons  and  short  combat  radius 
limit  their  ability  to  pursue  attacking  aircraft;  therefore, 
these  aircraft  can  easily  be  outrun  and  outmaneuvered .  The 
MiG-23  and  MiG-29  aircraft  are  far  more  capable.  They  have 
longer  range  missiles,  a  longer  combat  radius  and  greater 
speed;  therefore,  they  can  be  expected  to  aggressively  pursue 
attacking  aircraft.  Each  of  the  below  discussed  air  bases  is 
a  control  center  and  will  execute  the  defensive  strategy 
whenever  a  strike  penetrates  their  area  of  coverage.  Incoming 
strikes  are  detected  by  air-search  radars,  ground  units  and 
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naval  assets  and  are  relayed  to  the  nearest  control  center 
where  that  base  will  activate  its  SAM  sites  and  scramble 
fighter  aircraft.  Estimates  vary  but  it  is  expected  that  the 
base  will  scramble  a  moderate  number  of  aircraft  to  intercept 
the  enemy  strike  package. 

2.  Intelligence  Summary  Low 
a.  Chong jin 


•  13  aircraft  counted  outside  hangar  facilities;  4  Bombers, 
9  Fighters. 

•  2  structures  at  field.  1  hanger  and  1  weapons  storage 
facility. 

•  SA-2  and  SA-3  SAM  radar  emissions;  multiple  sites, 
quantity  of  each  site  is  unkno%m. 

•  Air-search  radars  in  continuous  operation,  operating 
parameters  unknown,  range  estimated  from  30-70  nm. 

•  Increased  message  traffic  between  Hamhung  and  Chong jin. 
Contents  include  aircraft  readiness  and  updates  about  US 
CV  battlegroup  composition. 

•  Higher  than  normal  amount  of  air-ground  transmissions. 

•  Increased  logistic  support  vehicle  traffic.  Contents 
believed  to  be  weapons,  type  ordnance  unknown. 


b.  Songjin 


•  22  fighter  aircraft  counted  outside  hangar  facilities. 

•  4  hangars  located  at  field. 

•  SA-2  and  SA-3  SAM  radar  emissions,  multiple  sites  most  of 
which  are  not  at  airfield  and  appear  to  be  at  random 
distances  from  Songjin. 

•  Air-search  radars  in  continuous  operation,  operating 
pareuaeters  unknown,  range  estimated  from  30-70  nm. 
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•  Routine  message  traffic  between  Song jin  and  Pyongyang. 

•  High  amount  of  message  traffic  between  Song jin  and 
unidentified  locations.  Contents  include  readiness 
reports  and  ordnance  status. 

•  Routine  logistic  support  vehicle  traffic. 

•  Normal  to  slightly  below  normal  amount  of  air-ground 
transmissions . 


c.  Hamhung 


•  15  fighter  aircraft  counted  outside  hangers. 

•  3  hangars^  1  weapons  storage  facility  and  1  communications 
facility. 

•  SA-2  and  SA-3  SAH  radar  emissions;  multiple  sites, 
quantity  of  each  site  is  tinknown. 

•  Air-search  radars  in  continuous  operation,  operating 
parameters  unknown,  range  estimated  from  30-70  nm. 

•  Increased  message  traffic  between  Hamhung,  Chong jin, 
Wonson  and  Pyongyang.  Contents  Include  aircraft  readiness, 
logistics  support  and  updates  about  US  CV  battle  group 
composition. 

•  Routine  logistic  support  vehicle  traffic. 


d.  Wonson 


•  9  Bomber  aircraft  counted  at  field  outside  hangars. 

•  4  hangars  and  1  weapons  storage  facility. 

•  SA-2  radar  sites  are  up  and  SA-3  site  is  not  operational, 
anticipate  site  operational  soon. 

•  Air-search  radars  present;  operating  parameters  unknown 
and  range  estimated  from  30-70  nm. 

•  Increased  message  traffic  between  Wonson  and  Hamhung; 
contents  Include  logistic  information,  aircraft  readiness 
reports  and  pilot  efficiency  reports. 
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Increased  logistic  support  vehicle  traffic;  contents 
include  radar  parts  and  ordnance. 


e.  Pyongyang  *  Capital  City  * 


•  46  aircraft  counted  at  field  outside  hangars;  3  Bombers 
and  43  Fighters. 

•  10  hangars,  2  communications  facility,  3  weapons  storage 
depots,  and  numerous  hardened  bunkers.  This  is  the  hub  of 
all  command  and  control  activities  for  the  country. 

•  Multiple  SA~2,  SA-3  and  SA-'S  SAM  sites;  quantities  unknown 
and  exact  locations  imdetermined. 

•  Multiple  air>search  radars  present;  operating  parameters 
and  ranges  from  between  SO-yo  nm. 

•  Increased  message  traffic  between  Pyongyang,  Chong jin, 
Hamhung,  Wonson  and  Kanggye.  Contents  include  aircraft 
readiness  data,  pilot  efficiency  reports  and  logistics 
data. 

•  Routine  logistic  support  vehicle  traffic  to  Song jin, 
Hamhung  and  Sinuiju,  and  increased  logistic  support  to 
Chong jin  and  Wonson. 


f.  Sinuiju 


•  25  Fighter  aircraft  counted  at  field  outside  hangars. 

•  6  hangars  and  1  training  facility. 

•  SA>2  SAM  radar  emissions  present,  quantity  and  exact 
locations  unknown. 

•  Air-search  radar  present,  operating  parameters  unknown  and 
ranges  from  between  30-70  nm. 

•  Increased  message  traffic  between  Sinuiju  and  Kanggye. 
Contents  include  flight  sortie  data  and  SAM/AAA  location 
inquiries . 

•  Routine  logistics  support  vehicle  traffic. 
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g.  Kanggye  (TARGET) 


•  Multiple  SAM  and  AAA  sites  are  operational,  exact  types, 
quantities  and  locations  are  unknown. 

«  Increased  message  traffic  between  Kanggye  and  Sinuiju. 
Contents  include  flight  sortie  data  and  SAM/AAA  location 
inquiries . 

h.  Remote  SAM/AAA  Sites 

M\uaerous  remote  SAM/ AAA  sites  are  deployed 
throughout  the  country  to  help  defend  agai  ist  attack.  Most 
sites  are  located  to  the  north  and  south  of  all  bases  except 
Sinuiju.  A  few  sites  are  located  inland.  Exact  numbers  of 
sites  and  locations 

are  unknown;  however,  they  are  believed  to  be  composed  of  SA- 
2,  SA'l  and  ZSU'>23  components.  Some  sites  may  also  have  SA-5 
launchers . 

D.  MEDIUM  LEVEL  INITIAL  INTELLIGENCE  BRIEF 
1 .  Defensive  Stratctgy 

The  North  Koreans  utilize  a  coordinated  scheme  that 
combines  SAM  sites  and  fighter  aircraft  to  counter  air 
threats.  The  strategy  consists  of  dividing  the  country  into 
various  sectors  of  responsibility  with  a  control  base  being 
accountable  for  coordinating  the  use  of  SAM  sites  and  fighter 
aircraft  to  engage  attacking  aircraft.  MiG-19  and  MiG-21 
aircraft  are  not  very  capable  and  are  only  a  serious  threat  if 
they  are  in  very  close  proximity  to  a  potential  target. 
Fortunately,  their  short  range  weapons  and  short  combat  radius 
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Unit  their  ability  to  pursue  attacking  aircraft;  therefore, 
these  aircraft  can  easily  be  outrun  and  outmaneuvered .  The 
NiG~23  and  MlG-29  aircraft  are  far  more  capable.  They  have 
longer  range  missiles,  a  longer  combat  radius  and  greater 
speed;  therefore,  they  can  be  expected  to  aggressively  pursue 
attacking  aircraft.  Each  of  the  below  discussed  air  bases  is 
a  control  center  and  will  execute  the  defensive  strategy 
whenever  a  strike  penetrates  within  50  nm  of  the  base . 
Intelligence  estimates  that  the  Chongjin  defensive  perimeter 
is  30  nm.  Incoming  strikes  are  detected  by  air-search  radars, 
ground  units  and  naval  assets  and  are  relayed  to  the  control 
center  where  that  base  will  activate  its  SAN  sites  and 
scramble  fighter  aircraft.  Utilization  of  the  EA-6B  should 
reduce  the  detection  capabilities  of  the  search  radars  as  well 
as  reduce  the  SAM  threat.  Estimates  vary  but  it  is  expected 
that  the  base  will  scramble  a  moderate  number  of  aircraft  to 
intercept  the  enemy  strike  package.  It  is  not  known  whether 
additional  aircraft  will  scramble  from  other  bases  or  to  what 
degree  SAM  sites  not  inside  of  the  controlling  center's  area 
of  responsibility  will  become  active. 

2.  Intelligence  Summary  Medium 
a.  Chongjin 

•  13  aircraft  counted  outside  hangar  facilities;  4  Badgers, 
7  NiG-23  and  2  MiG-29  aircraft. 

•  1  hanger  contains  6  additional  aircraft;  type  unknown. 
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•  Ordnance  transfers  between  weapons  storage  facility  and 
hangars  has  increased  significantly. 

•  Estinate  two  SA-2  and  two  SA-3  SAM  radar  sites,  suspected 
location  in  vicinity  of  airfield. 

•  Air-search  radars  in  continuous  operation,  operating 
intermittently,  detection  range  estimated  from  0-30  nm. 

•  Increased  message  traffic  between  Hamhung  and  Chong jin. 
Contents  include  Badger  aircraft  readiness,  air  traffic 
routes,  references  to  "Plan  A  and  Plan  B",  and  updates 
about  US  CV  battlegroup  composition. 

•  Higher  than  normal  amount  of  air-ground  and  air-air 
transmissions . 

•  Increased  logistic  support  vehicle  traffic.  Contents 
believed  to  be  air-air  and  air-surface  weapons. 


b.  Songjin 


•  22  fighter  aircraft  counted  outside  hangar  facilities;  10 
Mig-23,  5  MiG-21  and  7  MiG-29  aircraft. 

•  4  hangars  located  at  field  contain  an  additional  13 
aircraft,  type  unkno%m. 

•  SA-2  and  SA-3  SAM  radar  emissions.  Two  SA-3  sites  within 
vicinity  of  airfield.  One  SA-2  site  within  60  nm  north  of 
Songjin,  one  SA-2  site  within  60  nm  south  and  two  SA-2 
sites  within  60  nm  west  of  Songjin,  exact  locations 
unknown . 

•  Air-search  radars  in  continuous  operation,  operating 
parameters  unknoim,  detection  range  estimated  from  0-50 
nm. 

•  Routine  message  traffic  between  Songjin  and  Pyongyang. 

•  High  amount  of  message  traffic  between  Songjin  and 
unlocated  SAM  sites.  Contents  include  readiness  reports, 
ordnance  status,  and  increased  alert  status. 

•  Normal  to  slightly  below  normal  amount  of  air-ground 
transmissions  and  routine  air-to-air  transmissions. 

•  Routine  logistic  support  vehicle  traffic. 
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c,  Haahung 


•  15  fighter  aircraft  counted  outside  hanger  facilities;  6 
Mig-23,  5  MiG-21  and  4  MiG-19  aircraft. 

•  3  hangars  with  an  additional  10  aircraft  (total)  inside 
these  facilities.  1  weapons  storage  facility  and  1 
communications/aircraft  control  facility. 

•  SA-2  and  SA-3  SAM  radar  emissions;  multiple  sites  within 
vicinity  of  airfield. 

•  Air-search  radars  in  continuous  operation,  operating 
parameters  unknotm,  detection  range  estimated  from  0-50 
nm. 

•  Increased  message  traffic  between  Hamhung,  Chong jin, 
Wonson  and  Pyongyang.  Contents  include  aircraft  readiness, 
rendezvous  data.  Plan  A  and  Plan  B  composition 
requirements,  as  well  as  updates  about  US  CV  battle  group 
composition  and  position. 

•  Routine  logistic  support  vehicle  traffic. 


d.  Wonson 


•  9  Badger  aircraft  counted  at  field  outside  hangars. 

•  4  hangars  that  contain  an  additional  20  aircraft 
total.  1  weapons  storage  facility. 

•  Three  SA-2  radar  sites  located  in  vicinity  of  field  are  up 
and  SA-3  in  vicinity  of  field  is  not  operational  and  not 
expected  to  be  in  near  future. 

•  Air-search  radars  in  continuous  operation,  operating 
parameters  unknown,  detection  range  estimated  from  0-50 
nm. 

•  Increased  message  traffic  between  Wonson  and  Hamhung; 
contents  include  fighter  rendezvous  data.  Plan  A  and  Plan 
B  aircraft  coordination  schemes,  logistic  information, 
aircraft  readiness  reports  and  pilot  efficiency  reports. 

•  Increased  logistic  support  vehicle  traffic;  contents 
include  radar  parts  and  ordnance  as  well  as  air-air  and 
air-surface  weapons. 
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e.  Pyoi^ang  *  Capital  City  * 


•  46  aircraft  counted  at  field  outside  hangars;  3  Badgers, 
6  MiG-29,  14  MiG-23,  16  Mig-21  and  7  MiG-21  aircraft. 

•  10  hangars  with  an  additional  20  aircraft  total.  2 
connunications/aircraft  control  facilities,  3  weapons 
storage  depots ,  and  nvinerous  hardened  command  bunkers . 
This  is  the  hub  of  all  command  and  control  activities  for 
the  country. 

•  Multiple  SA-2,  SA-3  and  SA-5  SAM  sites  within  airfield 
vicinity  and  surrounding  the  city. 

•  Multiple  air-search  radars  present  in  continuous 
operation,  detection  range  estimated  from  0-50  nm. 

•  Increased  message  traffic  between  Pyongyang,  Chong jin, 
Hamhung,  Wonson  and  Kanggye.  Contents  include  aircraft 
readiness  data,  pilot  efficiency  reports.  Plan  A  and  Plan 
B  compositions,  rendezvous  positions,  communication  plans 
and  logistics  data. 

•  Routine  logistic  support  vehicle  traffic  to  Songjin, 
Hamhung  and  Sinuiju,  and  increased  ordnance  logistic 
support  to  Chong jin  and  Wonson. 


f.  Sinuiju 


•  25  MiG-21  aircraft  counted  at  field  outside  hangars. 

•  6  hangars  with  an  additional  7  aircraft  total  in  the 
facilities  and  1  training  facility  utilized  for  flight 
training. 

•  Three  SA-2  SAM  sites  presently  located  in  vicinity  of  the 
airfield. 

•  Air-search  radars  in  continuous  operation,  operating 
parameters  unknown,  detection  range  estimated  from  0-50 
nm. 

•  Increased  message  traffic  between  Sinuiju  and  Kanggye. 
Contents  include  flight  sortie  data,  SAM/AAA  location 
inquiries  and  operational  status  reports,  and  aircraft 
support  updates. 

•  Routine  logistics  support  vehicle  traffic. 
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g.  Kai^pgye  (TARGET) 


•  Three  SA-2  and  two  SA-3  SAM  sites,  as  well  as  two  ZSU-23 
AAA  sites  are  operational,  exact  locations  are  unknown  but 
are  in  close  proximity  to  weapon  research  facility. 

•  Increased  message  traffic  between  Kanggye  and  Sinuiju. 
Contents  include  SAM/AAA  location  and  status  reports, 
aircraft  support  requirements  and  communications 
reliability  reports. 

h.  Remote  SAM/AAA  Sites 

Numerous  remote  SAH/AAA  sites  are  deployed 
throughout  the  country  to  help  defend  against  attack.  Most 
sites  are  located  to  the  north  and  south  of  all  bases  except 
Sinuiju  and  form  a  formidable  barrier  against  air  attacks  from 
the  sea.  A  few  sites  are  located  inland  along  suspected 
aircraft  ingress/egress  routes  in  the  vicinity  of  Song jin. 
Song  jin  is  a  major  base,  and  it  has  a  larger  number  of  SAM 
sites  in  its  control  area  due  to  its  central  position  along 
the  coast.  Exact  numbers  of  sites  and  locations  are  unknown; 
however,  they  are  believed  to  be  deployed  near  coastal  cities 
and  around  airbases.  These  sites  are  composed  of  SA-2,  SA-3 
and  ZSU-23  components. 

E.  HIGH  LEVEL  INITIAL  INTELLIGENCE  BRIEF 
1 .  Defensive  Strategy 

The  North  Koreans  utilize  a  coordinated  scheme  that 
combines  SAM  sites  and  fighter  aircraft  to  counter  air 
threats.  The  strategy  consists  of  dividing  the  country  into 
various  sectors  of  responsibility  with  a  control  base  being 
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accountable  for  coordinating  the  use  of  SAM  sites  and  fighter 
aircraft  to  engage  attacking  aircraft.  MiG-19  and  MiG-21 
aircraft  are  not  very  capable  and  are  only  a  serious  threat  if 
they  are  in  very  close  proximity  to  a  potential  target. 
Fortunately,  their  short  range  weapons  and  short  combat  radius 
limit  their  ability  to  pursue  attacking  aircraft;  therefore, 
these  aircraft  can  easily  be  outrun  and  outmaneuvered .  The 
MiG-23  and  MiG-29  aircraft  are  far  more  capable.  They  have 
longer  range  missiles,  a  longer  combat  radius  and  greater 
speed;  therefore,  they  can  be  expected  to  aggressively  pursue 
attacking  aircraft.  Each  of  the  below  discussed  air  bases  is 
a  control  center  and  will  execute  the  defensive  strategy 
whenever  a  strike  penetrates  within  50  nm  of  the  base. 
Intelligence  estimates  that  the  Chongjin  defensive  perimeter 
is  30  nm.  Incoming  strikes  are  detected  by  air-search  radars, 
ground  units  and  naval  assets  and  are  relayed  to  the  control 
center  where  that  base  will  activate  its  SAM  sites  and 
scraablc  1/2  the  bases  total  niimber  of  fighter  aircraft  to 
intercept  the  enemy  strike  package.  Utilization  of  the  EA-6B 
should  reduce  the  detection  capabilities  of  the  search  radars 
as  well  as  SAM  effectiveness:  however,  once  detected,  the 
number  of  aircraft  scr&suiled  will  be  as  stated  above.  The 
other  control  centers  (those  not  penetrated)  will  become 
active  and  not  scramble  aircraft  until  their  defensive 
perimeter  has  been  penetrated;  however,  the  entire  country's 
SAM  network  will  become  active. 
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2.  Intelligence  sunary  High 


a.  Chong jin 


•  5  Badgers,  4  NiG-29  and  10  MiG-23  aircraft. 

•  Ordnance  supply  contains  AS-5  Kitchen,  AA-10  and  AA-7 
missiles. 

•  Two  SA-2  and  two  SA-3  SAM  radar  sites  located  at  airfield. 

•  Air-search  radars  in  continuous  operation,  detection 
ranges  from  0-30  nm. 

•  Message  traffic  between  Hamhung  and  Chong jin.  Contents 
include:  Fighter  patrol  vector  information  to  CV  CAP 
aircraft  positions,  fighter  and  bomber  flight  routes,  and 
updates  about  US  CV  battlegroup  composition  and  location. 

•  Higher  than  normal  amount  of  air-ground  and  air-air 
transmissions . 

•  Increased  logistic  support  vehicle  traffic.  Contents  are 
air-air  and  air-surface  weapons. 


b.  Songjln 


•  15  MiG-23,  10  MiG-29  and  10  MiG-21  aircraft. 

•  Ordnance  supply  contains  AA-7  and  AA-2  missiles. 

•  Two  SA-3  SAM  radar  sites  located  at  airfield  and  one  SA-2 
SAM  site  located  at  each  of  the  following  remote 
locations:  Kilju,  Tanchon,  Kapsan  and  Pungsan. 

•  Air-search  radars  in  continuous  operation,  detection 
ranges  from  0-50  nm. 

•  Routine  message  traffic  between  Song jin  and  Pyongyang. 

•  High  amount  of  message  traffic  between  Song jin  and  remote 
SAM  sites.  Contents  include  readiness  reports,  ordnance 
status,  and  increased  alert  status. 

•  Normal  to  slightly  above  normal  amount  of  air-ground 
transmissions  and  routine  air-to-air  transmissions. 

•  Routine  logistic  support  vehicle  traffic. 
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c.  Haahung 


•  10  MiG-19,  10  MiG-23  and  10  MiG-21  aircraft. 

•  Ordnance  supply  contains  AA-7,  AA-2  and  Sidewinder 
missiles. 

•  Tactical  Air  combat/Strike  Operations  Center.  This 
facility  handles  coordination  of  all  air  defense  and 
strike  assets  for  the  east  coast. 

•  Two  SA-2  and  two  SA-3  SAM  radar  sites  located  at  airfield. 

•  Air-search  radars  in  continuous  operation,  detection 
ranges  from  0-50  nm. 

•  Increased  message  traffic  between  Hamhung,  Chong jin, 
Wonson  and  Pyongyang.  Contents  include:  coordinated 
fighter  patrol  vector  information  to  CV  CAP  aircraft 
positions,  fighter  and  bomber  rendezvous/flight  routes, 
and  updates  about  U.S.  CV  battlegroup  composition  and 
location. 

•  Routine  logistic  support  vehicle  traffic. 


d.  Wonson 


•  10  Badgers,  10  MiG-29  and  15  MiG-23  aircraft. 

•  Ordnance  supply  contains  AS-5  Kitchen,  AA-10  and  AA-7 
missiles. 

•  Three  SA-2  and  one  SA-3  SAM  radar  sites  located  at 
airfield;  only  the  SA-2  sites  are  operational. 

•  Air-search  radars  in  continuous  operation,  detection 
ranges  from  0-50  nm. 

•  Increased  message  traffic  between  Wonson  and  Hamhung; 
Contents  include:  coordinated  fighter  patrol  vector 
information  to  CV  CAP  aircraft  positions,  fighter  and 
bomber  rendezvous/flight  routes,  and  updates  about  US  CV 
battlegroup  composition  and  location. 

•  Increased  logistic  support  vehicle  traffic;  contents 
include  radar  parts  and  ordnance  as  well  as  air-air  and 
air-surface  weapons. 
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e.  Pyongyang  *  Capital  City  * 


•  10  Badgers,  10  MiG-29,  20  NiG-23,  20  MiG-21  and  10  MlG-19 
aircraft. 

•  Ordnance  supply  contains  AS-5  Kitchen,  AA-10,  AA-7,  AA-2, 
AA-8  and  Sidewinder  missiles. 

•  Numerous  command,  control  communications  facilities.  This 
is  the  hub  of  all  command  and  control  activities  for  the 
country . 

•  Four  of  the  following  SAM  sites  located  at  the  airfield 
and  surrounding  the  city;  SA-2,  SA-3  and  SA-5. 

•  Air-search  radars  in  continuous  operation,  detection 
ranges  from  0-50  nm. 

•  Increased  message  traffic  between  Pyongyang,  Chong jin, 
Hamhung,  Wonson  and  Kanggye.  Contents  include:  political 
updates,  ROE,  defense  and  strike  plans,  and  updates  about 
US  CV  battlegroup  composition  and  location. 

•  Routine  logistic  support  vehicle  traffic  to  Song jin, 
Hamhung  and  Sinuiju,  and  increased  ordnance  logistic 
support  to  Chong jin  and  Monson. 


f.  Sinuiju 


•  40  MiG-21  aircraft. 

•  Ordnance  supply  contains  AA-2  and  AA-8  missiles. 

•  Three  SA-2  SAM  sites  located  at  the  airfield. 

•  Air-search  radars  in  continuous  operation,  detection 
ranges  from  0-50  nm. 

•  Increased  message  traffic  between  Sinuiju  and  Kanggye. 
Contents  include  air  defense  posture  for  protecting 
weapons  research  facility. 

•  Routine  logistics  support  vehicle  traffic. 


102 


g.  Kanggye  (TARGKT) 


•  Three  SA-2  and  two  SA-3  SAM  sites,  as  well  as  two  ZSU-23 
AAA  sites  are  operational  and  are  in  close  proximity  to 
weapons  research  facility. 

•  Increased  message  traffic  between  Kanggye  and  Sinuiju. 
Contents  include  air  defense  requests  for  protecting 
weapons  research  facility. 


h.  Rew>te  SAM/AAA  Sites 

Numerous  remote  SAN/AAA  sites  are  deployed 
throughout  the  cotintry  to  help  defend  against  attack.  T? 
sites  are  located  near  various  coastal  cities  and  bases 
are  spread  from  the  Chinese  border  and  extend  do%m  to  the 
border  with  the  ROK.  Some  inland  sites  are  deployed  and  are 
controlled  by  the  base  at  Song jin.  These  stations  are  located 
at  the  sites  listed  in  the  intelligence  summary  for  Song jin. 
These  sites  are  composed  of  SA-2,  SA-3,  SA-7  and  ZSU-'23 

components.  See  briefing  map  for  exact  locations. 

F.  FORCE  AND  NEAPONS  SUMMARY 
1.  US  Forces  and  Weapons 

a.  Niaitz  Battle  Group  located  approxiaately  270  na 
east  of  Wonson.  Battlegroup  coaposition  as 
follows: 

(1)  USS  Nimitz  -  Nimitz  Class  (CVN-68)/  Sea  Sparrow 

(2)  USS  Bunker  Hill  -  Aegis  Class  (CG-47)/  SM-2  MR 

(3)  USS  Jouett  -  Belknap  Class  (CG-26)/  SM-2  ER 

(4)  USS  Caron  -  Spruance  Class  (DD-963)/  Sea  Sparrow 

(5)  USS  Scott  -  Kidd  Class  (DDG-993)/  SM-1  MR 

(6)  USS  Clark  -  Perry  Class  (FFG-7)/  SM-1  MR 

(7)  USS  Boone  -  Perry  Class  (FPG-7)/  SM-1  MR 

(8)  USS  St\inp  -  Spruance  Class  (DD-963)/  Sea  Sparrow 
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b.  Surfac«**to-Alr  Weapons 

(1)  SM-2  ER  /  90  NM  Max  Range 

(2)  SN-2  MR  /  50  NM  Max  Range 

(3)  SM>1  MR  /  25  NM  Max  Range 

(4)  NATO  Sea  Sparrow  /  7  NM  Max  Range 

c.  Aircraft  onboard  Niaitz 


Type  Missions  /  Weapons  Loadout^ 


20  F-14A  CAP/Escort  /  4  SPAR,  2  PHOE 

28  F/A-18  Strike/CAP  /  STRIKE:  2  MK-82,  1  MK-83, 

/  1  HARM,  2  SWDR,  4  SPAR 
/  CAP/BSOCffiT:  2  SWDR,  4  SPAR 
/  12  MK-83 
/  None 
/  None 
/  None 

/  2  HARPOONS 
/  None 


8  A-6E  Strike 
6  EA-6B  Jaaming 
3  KA-6D  Tanker 
2  KS-3A  Tanker 
8  S-3B  Strike/SSC 

5  E-2C  AEW 

6  SH-3H  SAR/SSC 


/  None 


Weapon 

Pescription 

Range 

HARPOON 

Medium  range  ASM 

72  NM 

SWDR 

Short  range  AAM 

9  NM 

SPAR 

Medium  range  AAM 

30  NM 

PHOE 

Long  range  AAM 

60  NM 

NK>82 

Iron  Bomb 

Free  Fall 

MK>83 

Iron  Bomb 

Free  Fall 

HARM 

High  speed  ARM 

40  NM 

1.  For  gane  simplicity,  these  weapons  loadouts  are 
the  only  configurations  available. 

*  F/A'-18  aircraft  can  be  configured  for  either  a 
CAP/ESCORT  or  STRIKE  mission. 


d.  CAP  Stations 


(1)  2  F-14  9  260  degrees  100  nm  from  CV 

(2)  2  F-18  9  320  degrees  100  nm  from  CV 

(3)  1  E-2C  9  270  degrees  50  nm  from  CV 

2.  North  Korean  Forces  and  Weapons 

a.  The  following  airbases/c(»nand  centers  are 

known.  See  Intel ligcuice  Brief /Summary  for  latest 
intelligence  reports. 

(1)  Chong jin 
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(2)  Song jin 

(3)  Hanhung 

(4)  Wonson 

(5)  Pyongyang 

(6)  slnuiju 

b.  Aircraft  in  North  Korean  inventory 


Aircraft 

Missions  /  weapcns  LcadQUt 

MiG-19 

Air  Defense  /  2 

SWDR 

MiG-21 

Air  Defense  /  2 

AA-2,  2  AA-8 

fiC  4  AA-8 

MiG-23 

Fighter/Attack/  2 

AA-8,  2  AA-7  fir 

4 

500-KG  bombs 

MiG-29 

Air  Defense  /  6 

AA-10  fit  8  AA-11 

2 

AA-9 

TU-16 

Attack  /  2 

AS-5 

HfiAfiSD 

Descrlctlon 

Range 

AA-2 

Short  range  AAM 

4  NM 

AA-7 

Medium  Range  AAM 

19  NM 

AA-8 

Short  Range  AAM 

4  NM 

AA-9 

Long  Range  AAM 

70  NM 

AA-10 

Medium  Range  AAM 

16  NM 

AA-11 

Short  Range  AAM 

10  NM 

SNDR 

Short  range  AAM 

9  NM 

500KG 

Iron  Bomb 

Free  Fall 

AS-5 

Medium  Range  ASM 

80  NM 

c.  Surface-to-Air  (SAN)  inventory 

HfiABOn 

Description 

Range 

SA-2 

Medium  Range  SAM 

20  NM 

SA-3 

Medium  Range  SAM 

13  NM 

SA-5 

Long  Range  SAM 

135  NM 

SA-7 

Short  Range  SAM 

3  NM 

ZSU-23 

Short  Range  AAA 

2  NM 
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APPENDIX  P:  PRB-SIMDLATIQN  BRIEF 


A.  NAP  DEPICTING: 

(a)  Aircraft  type/count 

(b)  Air-search  radar  ranges 

(c)  SAH  sites/ranges 

(d)  Target  area 

(e)  CV  Task  Force  position  (260  NM  east  of  Wonsan) 

B.  SCENARIO 

(a)  Background 

(b)  Mission 

(c)  General  ROE 

(1)  overflight  of  South  Korea,  China  prohibited 

(2)  Protection  of  CV 

(3)  Maximize  bombs  on  target/Minimize  aircraft  losses 

(d)  AAW  ROE 

(1)  CAP  -  aircraft  loadout  fixed 

(2)  100-150  NM  —  VID/Escort  (if  required) /Comm  Air-BO 

(3)  <  100  NM  —  Engagement  (if  required) 

If  NK  6  ORD  6  Warn  &  WRP  then  Engage 

(4)  >  100  NM  —  Engage  only  if  lit-up 

(e)  ASUW  ROE 

(1)  Mod-Locked 

(2)  <  150  NM  —  ID/Track  (SSC  aircraft) 

(3)  Engagement  of  NK  Naval  Forces 
If  <  50  NM  or  Attack  Air  assets 

(f)  AIR-STRIKE  ROE 

(1)  Over  Land  -  Weapons  Free  Enemy  Air 

(2)  Over  Water  -  Engage  only  if  lit-up  or  AAW  ROE  applies 

(3)  MiG  Sweeps  are  O.K.  (if  defensive) 

C.  RE-FUELING 

(a)  In-Flight  —  feet  dry  :  will  be  refueled  automatically 

—  feet  wet  ;  player  needs  to  recover  or  tank 
—  At  50%  planes  bingo 

—  over  the  target:  dump  bombs  and  proceed  RTB 

(b)  Recover  Aircraft  :  takes  time  to  launch  again  during  game. 

D.  LAUNCHING  AIRCRAFT 

All  aircraft  on  alert  7,  so  do  not  need  to  worry  about  alerts. 
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E.  ASSISTANCE 

(a)  Enlisted  ~  CAP,HEL0S,S-3'S,  TANKERS  /  FEET  DRY  AIRCRAFT 

(b)  Dave  -  SIMULATED  STAFF  MEMBER,  INTEL  FEED,  AAW  CIRCUIT 

F.  AIRCRAFT  PACKAGE  CCEIPOSITIOM 

(a)  Fighter /Bomber  —  separation 

(b)  Section/Division/Single  —  splitting 

(c)  Aircraft  at  20,000  ft  unless  told  otherwise 

(d)  if  EA-6B  in  group,  speed  on  route  will  be  455  knots 

G.  IMPORTANT  COMMANDS 

(a)  Ships  can't  take  a  specific  track 

(b)  Weapons  free  air  vs  weapons  free  enemy  air 

(c)  Ships  radars  off  at  start  of  game 

(d)  Planes  take  off  with  radars  on 

(e)  Jamming  of  EA-OB  is  initially  off 

(f)  Range  circles,  X  marks,  posits,  track  select 

(g)  ASTABS  -  F*fuel,  V«availabillty ,  A*  aircraft  status 

int,  Cs  deuaage 

H.  STRIKE  PACKAGE  LAUNCH 

Within  15  minutes  of  game  start. 

I.  MISCELLAMBODS 

1.  daytime  mission  ~  WX  is  good,  visibility  is  good 

2.  All  aircraft  on  all  ships  are  FMC 

3.  Nig  patrols  have  been  common  but  there  has  been  no 
shooting 

4.  Comm  Air  in  the  game 

5.  Each  player  gets  3  Intel  updates 

6.  TAKE  COMMANDS  ARE  BETTER  TO  USE  THAN  WEAPONS  FREE  ! 

7.  Need  to  tell  us  what  ships  you  want  firing  missiles 

8.  activate  RBOC  and  chaff  on  your  command  ONLY 

9.  NORTH  KOREANS  KNOW  WHERE  YOU  ARE  AND  HAVE  PERFECT  INTEL. 

J.  BRIEF  GIVEN  INSIDE  IN  FRONT  OF  DISPLAY 

1.  LEFT  BUTTON  «  LAT/LONG, RANGE  &  BEARING 

2.  CENTER  BUTTON  «  HOOK  TRACK  :  GET  TN,  COURSE,  SPEED 

3.  X~MARKS,  CIRCLES,  ROUTES  ETC. 

4.  YELLOW  SYMBOL  :  FADING 

5.  BIG  SCREEN  SET-UP 
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APPBHDIX  G:  SCENARIO 


A.  BACKGROUND 

During  the  past  few  years  concern  for  the  North  Korean 
nuclear  research  program  has  become  a  prime  source  of 
international  importance.  The  North  Koreans  have  adamantly 
opposed  international  efforts  to  restrict  their  research  and 
development  of  nuclear  technology.  As  a  result,  the 
government  of  North  Korea  has  been  unwilling  to  comply  with 
UN  nuclear  weapons  proliferation  and  research  resolutions  by 
denying  UN  atomic  energy  coamission  inspectors  access  to 
their  nuclear  research  facility  located  at  Kanggye. 

After  months  of  deliberations,  the  UN  has  finally  given 
the  US  permission  to  conduct  limited  strike  operations 
against  North  Korean  nuclear  facilities  if  the  North  Korean 
government  does  not  comply  with  the  UN  resolutions.  South 
Korea  is  very  concerned  about  reprisals  from  the  north  and 
has  elected  not  to  participate  in  any  offensive  actions 
against  North  Korea. 

The  Nimitz  battlegroup  is  already  in  the  Sea  of  Japan 
where  it  has  just  completed  conducting  operations  in  support 
of  Team  Spirit  94  with  other  allied  countries.  In  response. 
North  Korea  has  upgraded  its  military  readiness  level  and 
placed  its  forces  on  alert. 
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B.  MISSION  DESOaPTION 

The  National  Security  Council  (NSC)  has  ordered  the 
Nimitz  battle  group  to  plan  and  conduct  an  air  strike 
against  the  nuclear  weapons  research  facility  located  at 
Kanggye  due  to  the  North  Korean's  non-compliance  with  UN 
resolutions.  Because  of  the  sensitivity  of  the  mission  and 
the  media  attention  that  it  will  generate,  a  TLAN  strike  is 
not  authorized  due  to  collateral  damage  from  cruise  missiles 
that  did  not  reach  the  target.  Additionally,  the  video 
coverage  that  is  provided  by  aircraft  on  target  will  further 
support  the  UN  position  and  challenge  any  false  claims  by 
the  North  Korean  government  about  civilian  casualties  and 
excessive  force  being  levied  against  their  country  and 
people. 

The  US  mission  is  to  destroy  the  North  Korean  nuclear 
weapons  research  facility  at  Kanggye.  No  other  offensive 
action  shall  be  taken  against  North  Korean  forces.  Hostile 
aircraft  and  naval  forces  may  only  be  engaged  if  they 
threaten  the  aircraft  strike  group  or  carrier  battle  group. 
Damage  to  the  North  Korean  military  infrastructure  is  not 
the  mission  objective  and  must  be  avoided  at  all  costs. 
Consequently,  no  offensive  strikes  will  be  launched  against 
these  types  of  targets. 

C.  RULES  OF  EMGAGEMENT 

1.  General  Mission  Restrictions: 
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•  US  forces  available  consist  of  only  the  Nieitz  Battle 
group  currently  located  in  the  Sea  of  Japan. 

•  No  strikes  may  originate  from  South  Korea. 
Additionally,  overflight  of  South  Korea  by  aircraft  is 
strictly  prohiliitfld. 

•  China  has  repeatedly  warned  that  it  will  not  tolerate 
any  violations  of  its  territorial  waters  or  airspac^^; 
therefore,  overflight  of  China  is  prohibited. 

•  Every  attempt  should  be  made  to  minimize  aircraft 
losses;  however,  the  target  is  classified  as  high  risk 
and  must  be  taken  out  at  all  costs. 

•  The  survival  of  the  Nimitz  battlegroup  is  of  paramount 
Importance  and  destruction  of  even  one  ship  is 
unacceptable . 


2.  Anti-Air  Warfare  Intentions: 


•  Currently  two  CAP  stations  are  up  and  manned  with  a 
section  (2)  of  fighters  on  each  and  one  E-2C  airborne 
and  on  station  providing  surveillance  for  the  Nimitz 
battlegroup.  This  may  be  modified  as  desired. 

•  At  the  present  time,  air  weapons  status  is  yellow  and 
hold.  At  no  time  are  US  aircraft  to  allow  North  Korean 
aircraft  to  gain  an  offensive  position  that  would  allow 
them  to  successfully  strike  the  carrier  battlegroup. 

•  All  aircraft  will  be  intercepted  and  identified  when 
they  enter  within  150  nm  of  the  Nimitz.  Commercial 
aircraft,  once  identified,  do  not  need  to  be  covered  if 
they  continue  to  operate  within  150  nm  of  the  Nimitz. 
Military. aircraft  will  be  covered  or  escorted  if  they 
operate  within  the  150  nm  boundary.  Once  these  aircraft 
exit  the  150  nm  boundary  the  CAP  aircraft  will 
discontinue  escort  duties. 

•  Aircraft  that  enter  within  100  nm  of  the  Nimitz  will  be 
engaged  only  if  all  of  the  following  occur: 

(a)  Aircraft  is  North  Korean 

(b)  Aircraft  is  carrying  ordnance 

(c)  Attempts  to  warn  off  aircraft  have  been  made. 

•  US  aircraft  will  not  engage  North  Korean  aircraft 
operating  in  international  airspace  unless  these 
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aircraft  initiate  hostile  actions  first  or  the 
guidelines  outlined  in  (4)  transpire. 


3.  Anti-Surface  Warfare  Intentions: 


•  US  naval  forces  must  maintain  a  12  nautical  mile  stand¬ 
off  from  all  coastlines. 

•  Primary  area  of  responsibility  (AOR)  is  150  nm  radius 
around  CV.  All  surface  contacts  within  this  AOR  will  be 
identified  and  tracked.  Any  North  Korean  surface  contact 
within  50  nm  of  the  Nimitz  will  be  tracked  and  monitored 
for  hostile  intentions.  If  hostile  actions  are  indicated 
it  may  be  engaged  if  it  closes  within  40  nm  of  the 
Nimitz. 

•  For  undisclosed  reasons  the  Nimitz  battlegroup  must 
maintain  its  current  station;  therefore ^  SSC  missions 
will  have  to  be  performed  with  aircraft. 

•  Offensive  actions  directed  against  North  Korean  naval 
forces  is  prohibited;  however,  US  surface  or  air  assets 
that  come  under  attack  by  these  naval  forces  may  respond 
in  kind. 

•  The  ASUW  threat  from  Noxrth  Korea  is  minimal  but  should 
not  be  totally  discounted. 


4.  Antl-Sutaarine  Warfare  Intentions: 


•  None,  no  s\ibmarine  threat. 


5.  Air-Strike  Rules  of  Engagement: 


•  The  strike  package(s)  will  be  weapons  free  enemy  air 
once  they  are  over  land.  During  ingress  and  egress  when 
over  water  the  strike  package(s)  may  not  engage  enemy 
aircraft  unless  they  are  being  tracked  with  fire  control 
radars . 

•  The  strike  objective  is  the  nuclear  weapons  research 
facility  located  at  Kanggye.  The  White  House  wants  this 
facility  totally  obliterated;  however,  this  facility  is 
so  large  that  eve.i  if  all  the  carrier's  planes  were  able 
to  drop  ordnance  on  it  in  a  single  strike,  it  would 
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still  not  be  enough  to  totally  destroy  it.  Subsequent 
strikes  will  be  required;  however,  the  greater  the 
amount  of  ordnance  that  can  be  placed  on  target 
initially  the  better. 

•  Strikes  against  air  bases  and  offensive  MiG  sweeps  are 
not  authorized.  Defensive  MiG  sweeps,  those  that  clear 
the  ingress/egress  path  for  the  strike  group,  are 
authorized.  SAM  sites  may  be  engaged  if  they  are  a 
threat  to  the  strike  group. 
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APPENDIX  H:  ORANGE  FORCES  SCRIPT 


A.  ORANGE  IS  NEAPONS  TIGHT  UNTIL  BLUE  INITIATES 
HOSTILITIES.  THIS  IS  DEFINED  BY: 

•  Violating  North  Korean  airspace  and/or  territorial 
waters.  In  the  game,  this  occurs  when  the  radar 
defensive  perimeter  of  the  detecting  base  is  penetrated. 

•  Blue  aircraft  engage  any  Orange  forces. 

•  If  one  of  these  items  take  place.  Orange  forces  are 
weapons  free  and  will  engage  Blue  forces  according  to 
the  following  script. 


B.  NIG  PATROLS 

At  the  start  of  the  game,  3  sorties  of  3  MiG-23  aircraft 
each  will  depart  from  Chong jin.  Song jin  and  Wonson.  These 
aircraft  will  close  the  carrier  battle  group  but  not  close 
to  within  100  nm  of  the  carrier.  The  following  routes  of 
flight  are  designed  to  test  carrier  CAP  aircraft  and  provide 
the  player  with  additional  tasks. 


C.  ORANGE  FIGHTER  AIRCRAFT  HILL  SCRAMBLE  FROM  THEIR 
RESPECTIVE  BASES  BASED  UPON  THE  FOLLONING  ALGORITHM: 

(a)  When  the  Blue  strike  penetrates  the  Orange  radar 
detection  bubble  for  a  base,  1/2  of  the  available  fighters 
will  scramble  (from  that  base)  to  intercept  the  incoming 
strike  group. 

(b)  The  second  breach  of  a  airbase  defense  zone  (by  a 
different  strike  group)  will  result  in  Orange  scrambling 
the  other  1/2  of  their  fighters. 

(c)  Orange  fighter  aircraft  (those  already  airborne  and 
those  scrambled)  will  intercept  and  engage  the  incoming 
Blue  aircraft. 
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(d)  The  Orange  fighters  will  continue  to  pursue  and  engage 
the  attacking  Blue  aircraft  until  one  of  the  following 
occurs : 


1.  All  attacking  Blue  aircraft  are  destroyed. 

2.  All  intercepting  Orange  aircraft  are  destroyed. 

3.  Orange  aircraft  must  RTB  for  fuel/ordnance. 

4.  The  Blue  aircraft  are  retreating  and  close  to  within 
100  nm  of  the  carrier. 

(e)  When  the  Blue  strike  group  penetrates  the  50  nm 
perimeter  around  Kanggye,  Orange  interceptors  will 
scramble  out  of  Slnuiju  based  upon  the  1/2  aircraft 
algorithm. 

(f)  NOTE:  When  a  base  scrambles  aircraft  to  intercept  a 
strike  group  that  breaks  its  perimeter,  the  aircraft 
launched  will  continue  the  pursuit  as  outlined  above; 
however,  the  base  will  not  launch  another  intercept  group 
against  the  same  strike  group  if  it  again  breaks  its 
defensive  bxibble.  For  example,  the  Hamhung  defensive 
border  is  violated  by  an  ingressing  strike.  Aircraft  are 
launched  and  pursue  the  strike  group.  After  the  attacking 
aircraft  strike  Kanggye  they  egress  back  through  the 
Hamhung  defensive  zone.  This  time  Hamhung  will  not  launch 
additional  interceptors  because  these  bogeys  are  already 
engaged. 


D.  WEAPONS  FREE  FOR  NIG  PATROLS 

The  Orange  MiG  patrols  that  are  launched  at  game  start 
will  proceed  on  their  routes  until  completion  and  then  land. 
However,  if  they  are  airborne  and  a  radar  bubble  is  broken 
by  the  Blue  strike  group,  they  will  pursue  and  engage  the 
striking  Blue  aircraft.  Aircraft  scrambles  from  the  airbases 
will  be  as  defined  above. 


E.  ORANGE  STRIKE  PLAN 

The  Orange  strike  force  will  launch  as  soon  as  the  Blue 
strike  group  is  over  Kanggye.  The  strike  force  will  consist 
of  the  following: 

•  4  MiG-29  and  5  Badger  aircraft  launched  from  Chong jin 
will  compose  the  north  strike  force. 
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5  Badgers  will  launch  from  Pyongyang  and  will  rendezvous 
over  Hamhung  with  4  MiG-29  aircraft  launched  from 
Wonson . 


•  4  MiG-29  and  5  Badger  aircraft  launched  from  Wonson  will 
compose  the  south  strike  force. 

These  strike  groups  will  proceed  along  their  routes  and 
attack  the  carrier  battlegroup  once  they  reach  maximum 
weapons  release  range  (80  nm)  and  then  return  home.  They 
will  not  break  off  the  attack  until  their  weapons  have  been 
released  or  they  have  been  destroyed.  The  sole  purpose  of 
the  fighter  escort  is  to  get  the  bombers  to  the  weapons 
release  point  and  back  home  again;  therefore,  the  Orange 
fighter  escort  will  not  engage  the  egressing  Blue  strike 
group  but  will  engage  Blue  CAP  aircraft  that  attempt  to 
intercept  the  Orange  strike  package.  They  will  continue  to 
provide  cover  for  the  bombers  after  the  weapons  have  been 
released  so  that  the  bombers  will  have  a  chance  to  return  to 
base.  The  fighter  escort  will  not  be  weapons  free  until  the 
package  is  100  nm  from  the  Nimitz  or  unless  the  package  is 
attacked  earlier  by  Blue  forces. 


F.  QRAMGE  SURFACE  UNIT  AAN  POSTURE 

Orange  naval  forces  will  launch  SA-7  weapons  if  Blue 
aircraft  fly  within  range  and  altitude. 


G.  ORANGE  SBORE  BATTERIES 

Orange  shore  batteries  and  remote  SAM  sites  initially 
will  not  be  active;  however,  as  soon  as  an  airbase  defensive 
perimeter  is  transgressed  these  sites  will  become  active  and 
attack  any  Blue  aircraft  within  range.  Blue  aircraft  may 
attack  these  sites  if  they  pose  a  direct  threat  to  the 
Kanggye  strike  group  ( i . e . ,  they  are  on  an  ingress/egress 
route ) . 


H.  NORTH  KOREA  ORDER  OF  BATTLE 

1 .  Chong jin 

5  Badgers  (2  AS-5  Kitchen) 

4  Mi6-29  (6  AA-10,  30  mm  gun) 
10  MiG  23  (2  AA-7,  23  mm  gun) 
2  SA-2  and  2  SA-3  SAM  sites 
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2.  Song jin 


10  MiG  29  (6  AA-10,  30  mm  gun) 

15  MiG  23  (2  AA-7,  23  nun  gun) 

10  MiG  21  (2  AA-2,  2  AA-8,  23  nm  gun) 
2  SA-3  SAM  Sites 


3.  Haahung 

10  MiG  19  (Sidewinders,  2  30  na  guns) 
10  MiG  23  (2  AA-7,  23  nm  gun) 

10  MiG  21  (2  AA>2,  2  AA-8,  23  mn  gun) 
2  SA>2  and  2  SA>3  SAM  Sites 


4.  Ilonson 

10  Badgers  (2  AS-S  Kitchen) 

10  MiG  29  (6  AA>10,  30  mm  gun) 
15  MiG  23  (2  AA'7,  23  mm  gun) 

3  SA-2  and  1  SA-3  SAM  sites 


5,  Pyongyang 

10  Badgers  (2  AS-5  Kitchen) 

10  MiG  29  (6  AA-10,  30  nm  gun) 

20  MiG  23  (2  AA-7,  23  mm  gun) 

20  MiG  21  (2  AA-2,  2  AA-8,  23  nm  gun) 
10  MiG  19  (rockets,  2  30  nan  guns) 

4  SA-2,  4  SA-3  and  4  SA-5  SAN  sites 


6.  Sinuiju 

40  MiG  21  (2  AA-2,  2  AA-8,  23  mm  gun) 

3  SA-2  SAN  Sites 

7.  Kanggye  (TARGET) 

3  SA-2  and  2  SA-3  SAN  Sites 
2  ZSU-23  AAA  sites 

8.  MO  Submarines  (Blue  or  Orange). 

9.  North  Korean  naval  forces  and  neutral  fishing 
vessels  located  in  various  locations  in  the  Sea  of  Japan 
and  Yellow  Sea. 
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10.  north  Koroan  shore  batteries  scattered  along  coast 
and  specific  inland  sites.  These  batteries  contain  SA-2, 
SA~3,  SA~7  and  ZSll-23  coiq)onents. 

11.  Aircraft  training  flints  at  game  start: 

a.  Flight  of  3  NiG  23'8  frtm  Chongjin. 

b.  Flight  of  3  NiG  23'8  fros  Songjin. 

c.  Flight  of  3  NiG  23'8  froa  NOnson. 


APPENDIX  I:  INTELLIGENCE  UPDATE  PROCEDURES 


A.  INTRODUCTION 

The  primary  premise  of  this  thesis  Is  to  assess  what 
different  levels  of  Information  have  upon  tactical  decision¬ 
making  with  regards  to  offensive  strike  capability  and 
defensive  posture  of  a  carrier  battlegroup.  To  accomplish  a 
test  of  this  hypothesis  It  was  decided  to  give  the  commander 
(the  player)  an  Initial  Intelligence  brief  based  on  the 
degree  of  resolution  for  that  particular  run  of  the  game, 
and  then  supply  the  player  with  updates  of  the  tactical 
situation  at  three  discrete  places  In  the  game,  those 
updates  also  being  of  the  same  resolution  of  the  Initial 
Intel  brief.  The  three  times  chosen  for  the  Information  to 
be  passed  to  the  commander  are  as  follows: 

1.  First  Update  Message 

This  message  is  given  to  the  player  upon  initial 
detection  of  the  Blue  Strike  Group  by  Orange  Forces.  These 
messages  will  supply  the  player  with  enemy  air  activity,  and 
the  information  content  and  flow  will  depend  upon  the 
resolution  of  the  particular  run.  This  would  be  the  first 
critical  decision  point  In  the  game  and  would  give  the  Blue 
player  the  opportunity  to  vary  tactics  such  as  ingress 
routes  and  strike  defensive  posture. 
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2.  S«ccmd  Update  Nesaage 

The  second  Infomation  update  was  given  when  the 
Blue  Strike  Group  closed  within  50  miles  of  the  target. 

This  gives  the  player  a  chance  to  make  decisions  with  regard 
to  carrier  defense  and  the  most  efficient  way  to  recover  the 
inbound  Blue  Strike  Package  upon  their  return. 

3.  Third  Update  Message 

The  third  update  consisted  of  current  information 
concerning  enemy  reaction  when  the  initial  Blue  aircraft 
reached  the  target  area.  This  information  was  critical  for 
determining  the  best  egress  route  for  the  strike  package  and 
also  for  helping  the  commander  with  the  defensive  posture  of 
his  forces. 

B.  MBSSA6B  UPDATBS 

1.  Very  Low  Intelligence,  First  Update  Message 


VL 

XX0015ZFEB94 
FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (VL~1) 

1.  The  North  Korean  Air  defense  Control  Center  located  at 

_  has  been  activated  in  response  to  the 

detection  of  unidentified  aircraft  that  appear  to  be  a 
threat  to  North  Korea.  Air-search  radars  located  at 
_  have  detected  the  threat. 

2.  Various  SAM  battery  aquisition  radars  have  been 
activated;  locations  unknoim. 

3.  Increased  communications  activity  between  Hamhung  and 
various  bases  in  North  Korea,  standby  for  further  updates. 
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2.  Very  Low  Intelligence,  Second  Update  Message 
VL 

XX0015ZFEB94 
FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (VL-2) 

1.  Increased  air  activity  at  Sinuiju  has  been  observed. 

2.  Nunerous  SAM  sites  have  been  activated;  Kanggye  is  known 
to  be  active. 

3.  Conaunications  between  Hanhung,  Chong jin,  Wonson  and 
Pyongyang  concerning  alert  aircraft  status. 


3.  Very  Low  Intelligence,  Third  Update  Message 

VL 

XX0015ZFEB94 
FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (VL-3) 

1.  Aircraft  have  been  launched  fron  Chong jin,  Hanhung  and 
Nonson.  The  type,  nuaber  of  aircraft  and  course  is  unknown. 

2.  All  SAM  sites  are  active  and  weapons  free. 


4.  Low  Resoluti<m  Intelligence,  First  Update  Message 

L 

FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (L-1) 

1.  The  North  Korean  Air  defense  Control  Center  located  at 

_  has  been  activated  in  response  to  the 

det€K;tion  of  unidentified  aircraft  that  appear  to  be  a 
threat  to  North  Korea.  Air-search  radars  located  at 

_  have  detected  the  threat  and  the  base  has 

begun  to  launch  fighter  aircraft. 

2.  SA-3  SAM  enlssions  in  the  _  area  have  been 

detected. 
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3.  Increased  coauunlcations  activity  from  Hanhung  to 
selected  bases  in  North  Korea.  Intelligence  reports  that 
Haahung  has  released  an  order  concerning  plan  "B"  execution. 
Contents  of  this  nessage  are  imkno%m  at  this  time.  Standby 
for  further  updates. 


5.  Low  Resolution  Intelligence,  Second  Update  Message 
L 

FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (L-2) 

1.  Sinuiju  is  launching  numerous  aircraft.  The  type,  number 
of  aircraft  and  course  is  unknown. 

2.  SA-2  and  SA-3  emissions  in  the  Kanggye  area  have  been 
detected.  SA-5  emissions  in  the  Pyongyang  area  have  been 
detected  and  all  other  SAM  sites  are  suspected  to  be  active. 

3.  Communications  between  Hamhung,  Chong jin,  Wonson  and 
Pyongyang  concerning  aircraft  rendezvous  positions  have  been 
intercepted. 


6.  Low  Resolution  Intelligence,  Third  Update  Message 
L 

FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (L-3) 

1.  Three  flights  of  aircraft  have  been  launched  from 
Chong jin,  Hamhung  and  Nonson.  The  type  and  number  of 
aircraft  is  unknown;  however,  they  do  not  appear  to  be 
headed  for  Kanggye. 

2.  All  SAM  sites  in  North  Korea  are  active  and  weapons  free. 


7.  Medium  Resolution  Intelligence,  First  Update  Nessage 
M 

XX0015ZFEB94 
FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (M-1) 
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1.  The  North  Korean  Air  defense  Control  Center  located  at 

_  has  been  activated  in  response  to  the 

detection  of  unidentified  aircraft  that  appear  to  be  a 
threat  to  North  Korea.  Air-search  radars  located  at 

_  have  detected  the  threat  and  the  base  has 

already  launched  _  fighter  aircraft  and  is  continuing 

to  launch  more  aircraft. 

2.  SA-2  and  SA-3  SAM  emissions  in  the  _  and 

Kanggye  area  have  been  detected. 

3.  Increased  communications  activity  from  Hamhung  to 
Chong jin,  Wonson  and  Pyongyang.  Intelligence  reports  that 
Hamhung  has  released  an  order  concerning  Badger  and  MiG 
rendezvous  positions.  Contents  of  this  message  are  unkno%m 
at  this  time.  Standby  for  further  updates. 


8.  Medium  Resolution  Intelligence,  Second  Update 
Message 


M 

XX0015ZFEB94 
FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (M-2) 

1.  Sinuiju  is  launching  numerous  MiG-21  aircraft.  Ten  have 
already  taken  off  and  more  are  launching.  The  destination 
and  mission  of  the  aircraft  is  unkno%m  but  the  aircraft  are 
headed  northeast. 

2.  All  SAM  sites  in  North  Korea  are  active  and  weapons  free. 

3.  Communications  between  Hamhung,  Chong jin,  Wonson  and 
Pyongyang  have  been  intercepted.  Contents  include  Badger  and 
MiG  rendezvous  positions  and  flight  routes. 


9.  Medium  Resolution  Intelligence,  Third  Update  Message 
M 

XX0015ZFEB94 
PM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (M-3) 

1.  Three  flights  of  Badger  and  NiG-29  aircraft  have  been 
launched  from  Chong jin,  Hamhung  and  Wonson.  The  exact  number 
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of  each  aircraft  is  unkno%m.  The  Badgers  are  believed  to  be 
loaded  with  AS-5  Kelt  missiles.  These  flights  appear  to  be 
headed  out  to  sea. 


10.  High  Resolution  Intelligence,  First  Update  Message 


H 

FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (H-1) 

1.  The  North  Korean  Air  defense  Control  Center  located  at 

_  has  been  activated  in  response  to  the 

detection  of  unidentified  aircraft  that  appear  to  be  a 
threat  to  North  Korea.  Air-search  radars  located  at 

_  have  detected  the  threat  and  the  base  is 

launching  _  fighter  aircraft  to  intercept  and  engage 

the  threat. 

2.  SAM  bases  throughout  the  country  have  been  activated  and 
all  have  received  a  weapons  free  order  and  will  engage  any 
enemy  aircraft  within  range. 

3.  Increased  communications  activity  from  Hamhung  to 
Chong jin,  Wonson  and  Pyongyang.  Intelligence  reports  that 
Hamhung  has  released  an  order  concerning  Badger  and  MiG 
rendezvous  positions  for  the  upcoming  retaliatory  action 
against  the  U.S.  forces. 


11.  High  Resolution  Intelligence,  Second  Update  Message 
H 

FM  CTF  77 
TO  CTG  77.1 

SUBJ:  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (H-2) 

1.  Sinuiju  is  launching  20  MiG-21  aircraft.  These  aircraft 
are  headed  for  Kanggye  to  engage  the  U.S.  strike  package 
enroute. 


12.  High  Resolution  Intelligence,  Third  Update  Message 
H 

FM  CTF  77 
TO  CTG  77.1 
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SUBJ;  KOREAN  THEATER  INTELLIGENCE  UPDATE  REPORT  (H-3) 

1.  Three  flights  of  5  Badger  and  4  MiG-29  aircraft  have 
been  launched  from  Chong jin,  Hamhung  and  Wonson.  The  Badgers 
are  loaded  with  3  AS-5  Kelt  missiles  per  aircraft.  These 
flights  appear  to  be  headed  for  the  U.S.  carrier  task  force 
in  retaliation  for  the  U.S.  strike  against  North  Korea. 


124 


APPENDIX  J:  PLAYER  DEBRIEF 


1.  Name: _ Resolution: _ 

2.  Mission  Planning: 

(a)  Why  did  you  choose  the  strike  ingress  route  that  you 
did?  What  factors  influenced  your  decision? 

(b)  How  did  you  determine  the  number  and  type  of 
aircraft  that  you  utilized  in  your  strike  package? 
What  factors  influenced  your  decision? 

(c)  Why  did  you  choose  the  strike  egress  route  that  you 
did?  What  factors  influenced  your  decision? 

(d)  Was  the  Initial  intelligence  brief  helpful  in 
planning  the  strike  package  composition  and  CV 
defensive  posture? 

(e)  Were  the  intelligence  updates  helpful  in  modifying 
your  strike  plan  and/or  defending  the  task  force?  If 
yes,  how  was  the  Information  useful? 


3.  Intelligence  Data: 

(a)  What  items  in  the  initial  brief  were  the  most 
helpful  in  assessing  the  situation.  Rank  the 
following  items  from  most  important  to  least: 

(  )  Aircraft  data:  number/type 

(  )  SAN  data:  type/location 

(  )  Logistics  data:  urgency/contents 

(  )  Communications  traffic:  contents/density 

(  )  Enemy  air  surveillance  data: 

locations/ranges 
(  )  Defense  Strategy 

(b)  Was  there  any  type  of  information,  not  included  in 
the  initial  brief,  that  would  have  influenced  the  way  you 
formulated  your  initial  strategy  and  plans? 


APPENDIX  K:  EN6AGSIEIIT  LOG 


A.  SUMNARY  OF  AIRCRAFT  LOST 

FIRING  DAMAGED 


TIME 

BASE/SHIP 

TARGET 

WEAPON 

PLATFORM 

020128Z 

VF203 

AA7 

FL404 

020130Z 

FL404 

SWDR 

VF224 

020130Z 

FL405 

SWDR 

VF224 

020130Z 

VQ200 

AA7 

FL400 

020130Z 

VF202 

AA7 

FL404 

020131Z 

FU401 

SPAR 

VF224 

020131Z 

FL403 

PHENX 

VF204 

020132Z 

VF224 

AAIO 

FU400 

020132Z 

VF225 

AAIO 

FU400 

020132Z 

FU400 

SWDR 

VF224 

020133Z 

FL400 

SPAR 

VF228 

020133Z 

FL401 

SPAR 

VF228 

020134Z 

VF204 

SA2 

SA202 

020135Z 

FL402 

SPAR 

VF205 

020136Z 

VA204 

SA5 

PYONG 

020140Z 

FL500 

SWDR 

VF228 

020140Z 

VA207 

AA7 

FL500 

020141Z 

VA205 

AA7 

FL501 

020143Z 

FL501 

SPAR 

VF228 

020146Z 

VA200 

SA2 

SA202 

020148Z 

VF236 

SA2 

SA201 

020148Z 

VQ203 

SA2 

SA202 

020149Z 

VF205 

AAIO 

FU402 

020150Z 

VF232 

SA2 

SA201 

020152Z 

VF234 

AAIO 

FU404 

020152Z 

VF235 

AAIO 

FU404 

020153Z 

VF230 

AAIO 

FU404 

020154Z 

VF231 

AAIO 

FU404 

020156Z 

VA206 

SA2 

SA201 

020206Z 

✓F206 

AAIO 

FU300 

020206Z 

VF207 

AAIO 

FU300 

020215Z 

FU205 

SWDR 

VF200 

020215Z 

FU206 

SWDR 

VF200 

B.  LIST  OF  ALL  ENGAGEMEMTS 


TIME 

PLATFORM 

WEAPON 

TRACK 

TARGET 

RESULT 

RANGE 

MBURANGE 

020118Z 

SOHO 

GlOOl 

OA013 

VQ203 

M(  1) 

8 

191 

020118Z 

SA201 

SA2 

OA007 

VF224 

N(20) 

7 

201 

020119Z 

SOHO 

GlOOl 

OA013 

VQ203 

M(  1) 

8 

198 

020120Z 

SA201 

SA2 

OAOlO 

VF232 

M(20) 

6 

214 

020122Z 

SA202 

SA2 

OA007 

VF224 

M(20) 

22 

227 

020124Z 

PYONG 

SA5 

OA013 

VQ203 

M(25) 

128 

231 

020124Z 

SA202 

SA2 

OA008 

VF202 

N(20) 

8 

240 

020124Z 

SA203 

SA2 

OA008 

VF202 

M(20) 

23 

240 

020126Z 

SA202 

SA2 

OAOlO 

VF232 

M(20) 

5 

254 

020126Z 

SA203 

SA2 

OAOlO 

VP232 

M(20) 

19 

254 

020127Z 

PYONG 

SA5 

OA016 

VF230 

M(25) 

117 

251 

020128Z 

FL404 

AA7 

OA008 

VF202 

M(60) 

19 

267 

020128Z 

FL404 

AA7 

OA008 

VF202 

H 

19 

267 

020128Z 

SPLASH 

ENGAGE 

VF203 

H 

0 

0 

020129Z 

FL404 

AA7 

OA008 

VF202 

M(60) 

14 

273 

020130Z 

VF224 

SWDR 

BA200 

PL404 

H 

9 

270 

020130Z 

SPLASH 

ENGAGE 

PL404 

H 

0 

0 

020130Z 

VF224 

SWDR 

BA200 

FL404 

H 

9 

270 

020130Z 

SPLASH 

ENGAGE 

FL405 

H 

0 

0 

020130Z 

VF204 

PHENX 

BA200 

FL404 

H 

37 

270 

0201303 

VF204 

PHENX 

BA200 

FL404 

H 

37 

270 

020130Z 

VT228 

SWDR 

BA200 

PL404 

H 

9 

270 

020130Z 

VF228 

SWDR 

BA200 

FL404 

M(50) 

9 

270 

020130Z 

VF232 

SWDR 

BA200 

FL404 

H 

9 

270 

020130Z 

VF232 

SWDR 

BA200 

FL404 

H 

9 

270 

020130Z 

VF236 

SWDR 

BA200 

FL404 

M(50) 

9 

270 

020130Z 

VF236 

SWDR 

BA200 

FL404 

N(50) 

9 

270 

020130Z 

FL400 

AA7 

OA006 

VQ200 

H 

20 

279 

020130Z 

SPLASH 

ENGAGE 

VQ200 

H 

0 

0 

020130Z 

FL402 

AA7 

OA006 

VQ200 

H 

16 

279 

020130Z 

FL404 

AA7 

OA008 

VF202 

H 

16 

285 

020130Z 

SPLASH 

ENGAGE 

VF202 

H 

0 

0 

020131Z 

VF224 

SPAR 

BA255 

PU400 

M(65) 

23 

270 

020131Z 

VF224 

SPAR 

BA255 

FU400 

H 

23 

270 

020131Z 

SPLASH 

ENGAGE 

FU401 

H 

0 

0 

020131Z 

VF204 

PHENX 

BA255 

FL402 

M(70) 

48 

256 

020131Z 

VF204 

PHENX 

BA255 

FL402 

H 

48 

256 

020131Z 

SPLASH 

ENGAGE 

FL403 

H 

0 

0 

020131Z 

VF228 

SPAR 

BA255 

FU400 

M(65) 

23 

270 

020131Z 

VF228 

SPAR 

BA255 

FU400 

H 

23 

270 

020132Z 

KANGY 

SA2 

OAOlO 

VF232 

M(20) 

22 

297 

etc. 
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APPENDIX  L:  DATA  TABULATION  TABLE 


HftHSl 


RESOLUTION; 


Strike  Package  information: 

-  Number  of  packages:  _ 

-  Support  Package(s):  _ 

-  Composition: 


STK 

A-6E: 

F/A-18 (B); 

EA-6B; 

SUP 

F-14: 

F/A-18 (E); 

Other ; 

VW/KA/VS 

STK 

A-6E; 

F/A-18 (B); 

EA-6B; 

SUP 

F-14; 

F/A-18 (E); 

Other ; 

VW/KA/VS 

STK 

A-6E: 

F/A-18 (B); 

EA-6B; 

SUP 

F-14; 

F/A-18 (E); 

Other ; 

VW/KA/VS 

STK 

A-6E; 

F/A-18 (B); 

EA-6B; 

SUP 

F-14; _ 

_ F/A-18 (E); _ 

_ mother; _ 

_  VW/KA/VS 

Notes: 


CAP  Package  information 
Composition: 

CAP  F-14; _ F/A-18: _ 

SUP  E-2C:  TANKER: _ S-3  ; _  EA-6B: _ 

Inaress/Taraet  Losses 

Air/SAM  Air/SAM  Air/SAM  Air 

Strike  EscortStrk  Sup  NK 


Egress  Losses 

Alr/SAM  Air/SAM  Air/SAM  Air 

Strike  EscortStrk  Sup  NK 


Red  Strike  Losses 

TU-16  Hi6-29  US  CAP  Def  Sup 

TU-16  Lnchng  Hiss:  Missiles  Impacting: 
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#  NK  Fght  Lost  During  Ingress: 

#  NK  Fght  Lost  During  Egress: 

#  NK  Escort  Lost  During  Strike: 

#  NK  Badgers  Lost  During  Strike 

#  NK  Badgers  Launching  Missiles 


APPENDIX  M:  ANALYSIS 


A.  ANALYSIS  OF  VARIANCE  ON  the  »>»■****«“  of  Strike  Aircraft  that  reach  the 
Target  tram  Both  ccNoninities  based  on  Warfare  Specialty. 


SOURCE 

DF 

SS 

MS 

F 

P 

War  Spec 

1 

1.0 

1.0 

0.02 

0.898 

ERROR 

22 

1372.6 

62.4 

TOTAL 

23 

1373.6 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

.—4. — - 

0 

12 

18.583 

9.040 

( - 

- ) 

1 

12 

18.167 

6.562 

( - 

— ) 

- -+— - 

POOLED  STDEV  « 

7.899 

15.0 

18.0 

21.0 

24.0 

B.  ANALYSIS  OF  VARIANCE  (Nf  the  of  Strike  Aircraft  that  reach  the 

Target  fros  Both  coasunities  based  on  EoaiH  Inforsation  Levels. 


SOURCE 

DF 

SS 

MS 

F 

P 

Level 

3 

164.1 

54.7 

0.90 

0.456 

ERROR 

20 

1209.5 

60.5 

TOTAL 

23 

1373.6 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

0 

6 

15.333 

7.916 

( - 

) 

1 

6 

18.333 

7.916 

- ) 

2 

6 

22.500 

9.482 

( - 

- ) 

3 

6 

17.333 

5.164 

( - 

- ) 

— - 

POOLED 

STDEV  = 

7.777 

12.0 

18.0 

24.0 

30.0 

C.  ANALYSIS  OF  VARIANCE  (Ml  the  of  Strike  Aircraft  fros  the  TMCAIR 

coaaunity  that  reach  the  Target  based  on  Four  Infonation  Levels. 


SOURCE 

DF 

SS 

MS 

F 

P 

Level 

3 

72 

24 

0.23 

0.872 

ERROR 

8 

827 

103 

TOTAL 

11 

899 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- + 

0 

3 

18.00 

7.94 

( - 

1 

3 

19.67 

11.50 

2 

3 

21.67 

13.05 

(  — 

3 

3 

15.00 

6.93 

( - 

- ) 

POOLED 

STDEV  = 

10.17 

10 

20 

30 
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D.  ANALYSIS  OP  VARIANCE  ON  the  of  Strike  Aircraft  free  the  WOW 

rjicATR  c<»ninity  that  reach  the  Target  based  on  £quc  Inforsation 
Levels. 


SOURCE 

DF 

SS 

MS 

F 

P 

Level 

3 

181.7 

60.6 

1.66 

0.252 

ERROR 

8 

292.0 

36.5 

TOTAL 

11 

473.7 

INDIVIDUAL  95%  Cl'S 

FOR 

MEAN 

BASED  ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- + - 

— 

- 

0 

3 

12.667 

8.505 

( - 

-) 

1 

3 

17.000 

4.359 

(- 

- - 

— ) 

2 

3 

23.333 

7.234 

* - 

- ) 

3 

3 

19.667 

1.528 

( - 

-) 

- + - 

.-4- - 

POOLED 

STDEV  = 

6.042 

8.0 

16.0 

24 

.0 

32.0 

B.  MEAN  VALUE  DIFFERENTIAL  ANALYSIS  ON  the  Mumbar  of  Strike  Aircraft 
reaching  the  Target:  EsSiT  Inforsation  Levels. 


Grand  Mean 
18.375 


I 


_ 

Tac-Air 

Combined 

Non  Tac-Air 

18.583 

18.375 

18.167 

Level  0 

Level  0 

Level  0 

-0.583 

-3.042 

-5.500 

Level  1 

Level  1 

Level  1 

♦1.087 

-0.042 

-1.167 

Level  2 

Level  2 

Level  2 

♦3.087 

♦4.125 

♦5.166 

Level  3 

Level  3 

Level  3 

-3.583 

-1,042 

♦1.500 

Figur#  A 
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F.  ANALYSIS  OF  VARIANCE  <MI  the  *»»■>*«*»■  of  Strike  Aircraft  that  reach  the 
Target  from  Bath  ccnaunities  based  on  JWQ  Inforaation  Levels. 


SOURCE 

DF 

SS 

MS 

F 

P 

Level 

1 

57.0 

57.0 

0.95 

0.340 

ERROR 

22 

1316.6 

59.8 

TOTAL 

23 

1373.6 

INDIVIDUAL  95%  Cl'S  FOR 

:  MEAN 

BASED  ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- 

- + - 

0 

12 

16.833 

7.709 

( - 

1 

12 

19.917 

7.763 

( - 

*- - 

- ) 

- +— 

- +- - 

POOLED 

STDEV  = 

7.736 

14.0 

17.5 

21.0 

24.5 

G.  ANALYSIS  OF  VARIANCE  ON  the  of  Strike  Aircraft  that  reach  the 

Target  froa  the  tacatr  cosaunity  based  on  TWO  Inforaation  Levels. 


ANALYSIS 

OF  VARIANCE  ON 

Stk  TGT 

SOURCE 

DF 

SS 

MS 

F  p 

Level 

1 

0.8 

0.8 

0.01  0.929 

ERROR 

10 

898.2 

89.8 

TOTAL 

11 

898.9 

INDIVIDUAL  95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

1 

+ 

1 

1 

1 

1 

1 

1 

1 

1 

1 

+ 

1 

1 

1 

1 

1 

1 

1 

1 

1 

+ 

1 

— 

0 

6 

18.833 

8.886 

( - * - 

— ) 

1 

6 

18.333 

10.033 

( - * - 

-+ - + - +— 

.... 

POOLED  STDEV  « 

9.477 

10.0  15.0  20.0 

25.0 

H.  ANALYSIS  OF  VARIANCE  ON  the  Wumbmr  of  Strike  Aircraft  that  reach  the 
Target  fr<»  the  NOK-TJICAIR  coaaonity  based  on  TSQ  Inforaation  Levels. 


SOURCE 

DF 

SS 

MS 

F  p 

Level 

1 

133.3 

133.3 

3. 

92  0.076 

ERROR 

10 

340.3 

34.0 

TOTAL 

11 

473.7 

INDIVIDUAL  95%  Cl'S  FOR 

MEAN 

BASED 

ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

-+ - 

.. — 

0 

6 

14.833 

6.494 

( - 

- * - ) 

1 

6 

21.500 

5.089 

( - 

.* - 

-) 

— 

POOLED 

STDEV  = 

5.834 

10 

.0 

15.0  20.0 

25.0 
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I.  NBAN  VALOB  DIFFBUBITIAL  ANALYSIS  ON  the  of  Strike  Aircraft 

reaching  the  Target:  Xkfi  Inf creation  Levels. 


tigatt  a 


J.  ANALYSIS  OP  VARIANCE  ON  the  PBrcBnt  of  Strike  Aircraft  that  reach  the 
Target  fron  Sa^h,  coeeunities  based  on  Warfare  Specialty. 

SOURCE  OF  SS  MS  F  p 

War  Spec  1  0.1047  0.1047  2.84  0.106 

ERROR  22  0.8095  0.0368 

TOTAL  23  0.9141 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


LEVEL  N  MEAN  STDEV  - + - + - + - 

0  12  0.8845  0.1588  ( - * - ) 

1  12  0.7525  0.2200  ( - * - ) 

POOLED  STDEV  »  0.1918  0.70  0.80  0.90 

K.  ANALYSIS  OP  VARIANCE  (Nl  the  Percent  of  Strike  Aircraft  that  reach  the 
Target  fron  BB^h  craeunities  based  on  TUB  Inf creation  Levels. 

SOURCE  DF  SS  MS  F  p 

Level  3  0.1733  0.0578  1.56  0.230 

ERROR  20  0.7408  0.0370 

TOTAL  23  0.9141 


INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


LEVEL  N  MEAN  STDEV  — + - + - + - - 

0  6  0.7604  0.2634  ( - * - ) 

1  6  0.7436  0.2380  ( - * - ) 

2  6  0.9593  0.0646  ( - * - ) 

3  6  0.8107  0.1340  ( - * - ) 

— + - + - + - + - 

POOLED  STDEV  «  0.1925  0.60  0.75  0.90  1.05 
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L.  ANALYSIS  OP  VARIANCE  ON  thtt  Parceat  of  Strike  Aircraft  that  reach  the 
Target  froa  the  rn—iinity  based  an  Pour  Inforaation  Levels. 


SOURCE 

DF 

SS 

MS 

P 

P 

Level 

3 

0.0454 

0.0151 

0.52 

0.679 

ERROR 

8 

0.2318 

0.0290 

TOTAL 

11 

0.2772 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 

BASED  ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

_+ - 

0 

3 

0.8750 

0.1250 

( - 

- * - ) 

1 

3 

0.8229 

0.2801 

( - 

- * - ) 

2 

3 

0.9861 

0.0241 

( - * - 

- ) 

3 

3 

0.8542 

0.1458 

( - 

- * - ) 

_+ - 

- - 

POOLED 

STDEV  * 

0.1702 

0.60 

0.80  1.00 

1.20 

H.  ANALYSIS  OP  VARIANCE  <Nf  the  Parcant  of  Strike  Aircraft  that  reach 
the  Target  froa  the  kom^mcair  cxaaunity  based  on  fEaiC  Information 
Levels. 


SOURCE 

DF 

SS 

MS 

F 

P 

Level 

3 

0.1554 

0.0518 

1.10 

0.404 

ERROR 

8 

0.3768 

0.0471 

TOTAL 

11 

0.5322 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- — + 

0 

3 

0.6458 

0.3442 

( - 

) 

1 

3 

0.6642 

0.2104 

( - 

-) 

2 

3 

0.9325 

0.0878 

( - 

*. - .... 

3 

3 

0.7673 

0.1340 

- ) 

POOLED 

STDEV  » 

0.2170 

0.50 

0.75 

1.00 

1.25 

N.  MEAN  VALUE  DIPPERENTIAL  ANALYSIS  ON  the  Percent  of  Strike  Aircraft 
reaching  the  Target:  Four  Inforaation  Levels. 


Tac-Aii 

CoobinNd 

Hon  Tac-Aii 

86.45% 

81.85% 

75.25% 

L«V«1  0 

l«v*l  0 

1.4V41  0 

-0.»5% 

-5.81% 

-10.67% 

L«V*1  1 

L8V«1  1 

L*v«l  1 

-6.16% 

-7.49% 

-8.83% 

L*V*1  2 

L8V«1  3 

livSI  3— 

*10.16% 

*14.08% 

*18.00% 

L*V*1  3 

L4V41  3 

3 

-3.03% 

-0.78% 

*1.48% 
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O.  ANALYSIS  OF  VARIANCE  ON  tli«  Pmrcant  of  Strike  Aircraft  that  reach  the 
Target  froa  Both  coaaunities  based  on  2kX2  Inforaation  Levels. 

SOURCE  DF  SS  MS  F  p 

Level  1  0.1062  0.1062  2.89  0.103 

ERROR  22  0.8079  0.0367 

TOTAL  23  0.9141 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 


BASED  ON  POOLED  STDEV 

LEVEL  N  MEAN  STDEV  - + - + - + - 

0  12  0.7520  0.2395  { - * - ) 

1  12  0.8850  0.1268  ( - * - ) 

POOLED  STDEV  »  0.1916  0.70  0.80  0.90 

P.  ANALYSIS  OF  VARIANCE  OM  the  Porcont  of  Strike  Aircraft  that  reach  the 
Target  fros  the  tacatj?  cosaunity  based  on  Xmq  Inforaation  Levels. 

SOURCE  DF  SS  NS  F  p 

Level  1  0.0152  0.0152  0.58  0.464 

ERROR  10  0.2620  0.0262 

TOTAL  11  0.2772 


INDIVIDUAL  95%  Cl'S  FOR  MEAN 


BASED  ON  POOLED  STDEV 

LEVEL  N  MEAN  STDEV  - + - + - + - 

0  6  0.8490  0.1961  ( - * - ) 

1  6  0.9201  0.1182  ( - * - ) 

POOLED  STDEV  *  0.1619  0.80  0.90  1.00 


Q.  ANALYSIS  OF  VARIANCE  ON  the  Percent  of  Strike  Aircraft  that  reach  the 
Target  froa  the  nom-rBCAiB  coaaunity  based  on  Dm  Inforaation  Levels. 

ANALYSIS  OF  VARIANCE  ON  %Stk  TGT 

SOURCE  DF  SS  NS  F  p 

Level  1  0.1140  0.1140  2.72  0.130 

ERROR  10  0.4183  0.0418 

TOTAL  11  0.5322 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


LEVEL  N  MEAN  STDEV  -+ - + - + - + - 

0  6  0.6550  0.2554  ( - * - ) 

1  6  0.8499  0.1358  ( - * - ) 

POOLED  STDEV  =  0.2045  0.48  0.64  0.80  0.96 
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R. 


NBAN  VALDB  DIFFERENTIAL  ANALYSIS  ON  the  Perceat  of  Strike  Aircraft 
reaching  the  Target:  TMS.  Infonation  Levels. 


Gzand  Mean 
81.85% 


I 


Tac-Air 

_ 1 _ 

Combined 

Non  Tac-Air 

88.46% 

81.85% 

75.25% 

Level  0 

Level  0 

Level  0 

-3.56% 

-6.65% 

-9.75% 

Level  1 

Level  1 

Level  1 

♦3.56% 

♦6.65% 

♦9.75% 

FIgiure  d 


S.  ANALYSIS  OF  VARIANCE  (»l  the  ttitmtwtr  of  Strike  Aircraft  reaching  the 
Target  based  on  the  mtmhar  of  Strike  Packages  launched.  Both 
conunities. 


SOURCE 

DF 

SS 

MS 

F 

P 

StrkPack 

2 

117.4 

58.7 

0.98 

0.391 

ERROR 

21 

1256.2 

59.8 

TOTAL 

23 

1373.6 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

— + - 

1 

8 

21.125 

8.459 

(  — 

- * - 

— ) 

2 

15 

17.333 

7.345 

( - * - ) 

3 

1 

12.000 

0.000 

( - 

- ) 

— + - 

POOLED  STDEV  * 

7.734 

0 

10 

20 

30 
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T.  ANALYSIS  OF  VARIANCE  ON  the  of  Strike  Packages  launched  t>ased 

on  the  Warfare  Specialty. 


SOURCE 

DF 

SS 

NS 

F 

P 

War  Spec 

1 

1.042 

1.042 

3.87 

0.062 

ERROR 

22 

5.917 

0.269 

TOTAL 

23 

6.958 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 

BASED  ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

-+ - 

- 

— 

0 

12 

1.5000 

0.5222 

( - 

- * - ) 

1 

12 

1.9167 

0.5149 

( - * - 

— ) 

-+ - 

- +- 

— 

POOLED  STDEV  = 

0.5186 

1.20 

1.50  1.80 

2.10 

U.  ANALYSIS  OF 

VARIANCE  ON  the  of  Strike  Packages  launched 

based 

on  Four  Information 

Levels;  Both  communities. 

SOURCE 

DF 

SS 

MS 

F 

P 

Level 

3 

1.458 

0.486 

1.77 

0.186 

ERROR 

20 

5.500 

0.275 

TOTAL 

23 

6.958 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 

LEVEL 

N 

MEAN 

STDEV 

BASED  ON 

POOLED  STDEV 

0 

6 

1.8333 

0.4082 

( - * - 

-) 

1 

6 

2.0000 

0.6325 

( - * - 

- ) 

2 

6 

1.3333 

0.5164 

( - 

— * - ) 

3 

6 

1.6667 

0.5164 

(■ 

- * - ) 

POOLED  STDEV  » 

0.5244 

1.00 

1.50  2.00 

2. 

50 

V.  ANALYSIS  OF  VARIANCE  ON  the  mimbar  of  Strike  Packages  launched  based 
on  Foot  Information  Levels;  TMCAIR  community. 


SOURCE 

Level 

ERROR 

TOTAL 

DF 

3 

8 

11 

SS 

1.000 

2.000 

3.000 

MS 

0.333 

0.250 

F  p 

1.33  0.330 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

_+ - 

— + - 

- +- 

0 

3 

1.6667 

0.5774 

(- 

* - 

- ) 

1 

3 

1.6667 

0.5774 

(- 

* - 

- ) 

2 

3 

1.0000 

0.0000 

( - 

—  *- 

) 

3 

3 

1.6667 

0.5774 

(“ 

-+ - 

* - 

- ) 

POOLED 

STDEV  = 

0.5000 

0.60 

1 

.20 

1.80 

2.40 
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W.  ANALYSIS  OF  VARIANCE  ON  the  of  Strike  Aircraft  reaching  the 

Target  based  on  the  of  Strike  Packages  launched;  tjhcair 

cosaninity. 


SOURCE 

DF 

SS 

MS 

F 

P 

StrkPack 

1 

24.1 

24.1 

0.28 

0.611 

ERROR 

10 

874.8 

87.5 

TOTAL 

11 

898.9 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 


BASED  ON  POOLED  STDEV 

LEVEL  N  MEAN  STDEV  - + - + - + - + 

1  6  20.000  9.445  ( - * - ) 

2  6  17.167  9.261  ( - * - ) 

POOLED  STDEV  =  9.353  12.0  18.0  24.0  30.0 


X.  ANALYSIS  OF  VARIANCE  ON  the  thtmht»r  of  Strike  Packages  launched  based 
on  gsaiC.  Information  Levels;  wow-tacatp  community. 


SOURCE 

DF 

SS 

MS 

Level 

3 

0.917 

0.306 

ERROR 

8 

2.000 

0.250 

TOTAL 

11 

2.917 

LEVEL 

N 

MEAN 

STDEV 

0 

3 

2.0000 

0.0000 

1 

3 

2.3333 

0.5774 

2 

3 

1.6667 

0.5774 

3 

3 

1.6667 

0.5774 

POOLED 

STDEV  * 

0.5000 

F  p 

1.22  0.363 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 
- + - + - + - +_ 

( - * - ) 

( - * - ) 

( - * - ) 

( - * - ) 

- + - + - + - +- 

1.20  1.80  2.40  3.00 


Y.  ANALYSIS  OF  VARIANCE  ON  the  *Hif»**»*"  of  Strike  Aircraft  reaching  the 
Target  based  on  the  of  Strike  Packages  launched;  NOW-TACAIR 

conDBunity. 


SOURCE  DF  SS  MS  F  p 

StrkPack  2  122.9  61.5  1.58  0.259 

ERROR  9  350.7  39.0 

TOTAL  11  473.7 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 


BASED  ON  POOLED  STDEV 

LEVEL  N  MEAN  STDEV  - + - + - + - + 

1  2  24.500  4.950  ( - * - 

2  9  17.444  6.386  ( - * - ) 

3  1  12.000  0.000  ( - * - ) 

- + - + - + - +■ 

POOLED  STDEV  =  6.243  0  10  20  30 


) 
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Fifuim  S 


tiUMBBR  OP  Strike  Aircraft  launched  based  on  the  Marfare  Specialty  and 
Intonation  Level:  Both  conmnities. 


Piflure  ^ 


AD.  ANALYSIS  OF  VARIANCE  (M  the  of  Strike  Aircraft  reaching  the 

Target  t>ased  on  the  of  Strike  Packages  launched.  Both 

coagninities. 


SOURCE 

DF 

SS 

MS 

F 

P 

StrkPack 

2 

117.4 

58.7 

0.98 

0.391 

ERROR 

21 

1256.2 

59.8 

TOTAL 

23 

1373.6 

INDIVIDUAL  95%  Cl'S  FOR 

MEAN 

BASED  ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- + - 

-+ - 

1 

8 

21.125 

8.459 

(  — 

— * - 

— ) 

2 

15 

17.333 

7.345 

( - * 

— ) 

3 

1 

12.000 

0.000 

( - 

- ) 

- + - 

- + - 

- 

POOLED  STDEV  = 

7.734 

0 

10 

20 

30 

AE.  ANALYSIS  OF  VARIANCE  ON  the  of  Strike  Packages  launched  based 

on  the  Warfare  Specialty.  JSqUi  conunities. 


SOURCE 

DF 

SS 

MS 

F 

P 

War  Spec 

1 

1.042 

1.042 

3.87 

0.062 

ERROR 

22 

5.917 

0.269 

TOTAL 

23 

6.958 

INDIVIDUAL  95% 

Cl'S  FOR  MEAN 

BASED  ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

-+ - 

0 

12 

1.5000 

0.5222 

( - 

- ) 

1 

12 

1.9167 

0.5149 

( - * - ) 

-+ — ..... 

- + - 

POOLED  STDEV  * 

0.5186 

1.20 

1.50 

1.80  2.10 

AF.  ANALYSIS  OF  VARIANCE  ON  the  mimhar  of  Strike  Packages  launched  based 
on  Two  Information  Levels.  Both  communities. 


ANALYSIS  OF  VARIANCE  ON  StrkPack 


SOURCE  DF 

Level  1 

ERROR  22 

TOTAL  23 

LEVEL  N 

0  12 

1  12 


POOLED  STDEV  = 


SS 

MS 

1.042 

1.042 

5.917 

0.269 

6.958 

MEAN 

STDEV 

1.9167 

0.5149 

1.5000 

0.5222 

0.5186 

F  p 

3.87  0.062 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


-+ - + - + - 

( - * 

( - * - ) 

-+ - + - + - 

1.20  1.50  1.80 


+' 


+ 


2.10 


) 


141 


AG.  ANALYSIS  OF  VARIANCE  (Nl  the  of  Strike  Packages  launched  based 

on  Two  Inforaation  Levels,  tmcair  coaaunity. 


ANALYSIS  OF  VARIANCE  ON  StrkPack 


SOURCE  DF 

Level  1 

ERROR  10 

TOTAL  11 

LEVEL  N 

0  6 

1  6 


POOLED  STDEV  = 


ss 

MS 

0.333 

0.333 

2.667 

0.267 

3.000 

MEAN 

STDEV 

1.6667 

0.5164 

1.3333 

0.5164 

0.5164 

F  p 

1.25  0.290 


INDIVIDUAL  95%  Cl'S  FOR  MEAN 

BASED  ON  POOLED  STDEV 

- + - + - + - + 

( - * - ) 

( - * - ) 

- + - + - - + - + 

1.05  1.40  1.75  2.10 


AH.  ANALYSIS  OF  VARIANCE  ON  the  wttmhttr  of  Strike  Aircraft  reaching  the 
Target  based  on  the  wttmhar  of  Strike  Packages  launched.  IVo 
Information  Levels.  TMIAIR  community. 


SOURCE 

DF 

SS 

MS 

F 

P 

StrkPack 

1 

24.1 

24.1 

0.28 

0.611 

ERROR 

10 

874.8 

87.5 

TOTAL 

11 

898.9 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

1 

6 

20.000 

9.445 

( - 

- ) 

2 

6 

17.167 

9.261 

( - 

- ) 

POOLED  STDEV  = 

9.353 

12.0 

18.0 

24.0 

30.0 

Al.  ANALYSIS  OF  VARIANCE  ON  the  thimbar  of  Strike  Packages  launched  based 
on  IVo  Information  Levels.  NON  TACAIR  community. 


SOURCE 

Level 

ERROR 

TOTAL 

LEVEL 

n 

DF 

1 

10 

11 

SS 

0.750 

2.167 

2.917 

NS 

0.750 

0.217 

crpnwtF 

F  p 

3.46  0.092 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 

n 

nciAn 

1  c.£in 

DXi/CiV 
n  N  AO  o 

u 

1 

o 

6 

1.6667 

w  •  4  w  O  A 

0.5164 

^  - - - 

( - * - ) 

— ) 

POOLED 

STDEV  = 

0.4655 

1.60  2.00  2.40 
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AJ.  ANALYSIS  OP  VARIANCE  ON  the  wu»fa**r  of  Strike  Aircraft  reaching  the 
Target  based  on  the  of  Strike  Packages  launched.  Ota 

Inforsation  Levels.  fl2S  TMCAIR  cosominity. 


ANALYSIS 

OF  VARIANCE  ON  Stk 

TGT 

SOURCE 

DF 

SS 

MS 

StrkPack 

2 

122.9 

61.5 

ERROR 

9 

350.7 

39.0 

TOTAL 

11 

473.7 

LEVEL 

N 

MEAN 

STDEV 

1 

2 

24.500 

4.950 

2 

9 

17.444 

6.386 

3 

1 

12.000 

0.000 

POOLED 

STDEV  = 

6.243 

F  p 

1.58  0.259 

INDIVIDUAL  95%  CI^S  FOR  MEAN 


BASED  ON  POOLED  STDEV 
- + - + - + - + - 

( - * - ) 

( - * - ) 

( - * - ) 

- + - + - + - + - 

0  10  20  30 


AK.  mmsER  OF  strike  Packages  laxmched  based  on  2^  Inforsation  Levels: 
Both  coBSunities. 


inronimon  wwvi 


Figure  S 
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AL.  MOMBKR  OF  Strike  Packages  launched  and  HMJM  MOMBSit  of  Strike 

Aircraft  reaching  the  Target:  Both  c<Mnunities. 


TAC-AIR 


NonTAC^ 


Eispixm  IS 


AM.  ANALYSIS  OF  VARIANCE ‘ON.,  the  Percent  of  Strike  Aircraft  reaching  the 
Target  based  on  the  tmmPtnr  of^  Strike  Packages  launched;  Both  coaoMuiities. 


SOURCE 

DF 

SS 

MS 

F 

P 

StrkPack 

2 

0.3285 

0.1642 

5.89 

0.009 

ERROR 

21 

0.5856 

0.0279 

TOTAL 

23 

0.9141 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- + — 

1 

8 

0.9531 

0.0875 

( - * 

2 

15 

0.7727 

0.1949 

(- 

-*— ) 

3 

1 

0.4286 

0.0000 

( - 

- 

-) 

- - 

POOLED  STDEV  = 

0.1670 

0.30 

0.60 

0.90 
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AN.  ANALYSIS  OF  VARIANCE  (W  the  Percent  of  Strike  Aircraft  reaching  the 
Target  iMsed  on  the  eitmhttr  of  Strike  Packages  launched;  TUCAIR 
ocnnunity. 


SOURCE 

DF 

SS 

MS 

F 

P 

StrkPack 

1 

0.1074 

0.1074 

6.33 

0.031 

ERROR 

10 

0.1698 

0.0170 

TOTAL 

11 

0.2772 

INDIVIDUAL 

95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

_+ - 

- 

1 

6 

0.9792 

0.0349 

( - 

- * - 

- ) 

2 

6 

0.7899 

0.1810 

( - 

.* - ) 

-+ - 

POOLED  STDEV  = 

0.1303 

0.72 

0.84  0 

.96 

1.08 

AO.  ANALYSIS  OF  VARIANCE  (El  the  Percent  of  Strike  Aircraft  reaching  the 
Target  based  on  the  eitmPtttr  of  Strike  Packages  launched;  NON  TACAIR 
coaaunity. 


SOURCE 

DF 

SS 

MS 

StrkPack 

2 

0.1356 

0.0678 

ERROR 

9 

0.3966 

0.0441 

TOTAL 

11 

0.5322 

LEVEL 

N 

MEAN 

STDEV 

1 

2 

0.8750 

0.1768 

2 

9 

0.7612 

0.2137 

3 

1 

0.4286 

0.0000 

POOLED 

STDEV  = 

0.2099 

F  p 

1.54  0.266 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 


BASED  ON  POOLED  STDEV 
— +— - +— - + - + - 

( - * - ) 

( - * - ) 

i - * - ) 

— + - + - + - + - 

0.00  0.35  0.70  1.05 


AP.  Percent  of  Strike  Aircraft  reaching  the  Target  based  on  the  mimhar  of 
Strike  Packages  launched:  Both  conunities. 


riform  U 
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AQ.  MBAII  PMScmrr  of  strike  Aircraft  reaching  the  Target  based  on  the 
of  Strike  Packages  launched:  Bnhh  coaoBunities . 


TA&AH  NonTAC-AR 


Flgurm  12 


AR.  ANALYSIS  OF  VARIANCE  ON  the  of  Badger  Aircraft  lost  prior  to 

reaching  their  weapon  Release  Point  based  on  Warfare  Specialty;  Both 
OoBBunities. 


SOURCE 

DF 

SS 

MS 

War  Spec 

1 

0.04 

0.04 

ERROR 

22 

176.92 

8.04 

TOTAL 

23 

176.96 

LEVEL 

N 

MEAN 

STDEV 

0 

12 

5.750 

2.527 

1 

12 

5.667 

3.114 

POOLED 

STDEV  * 

2.836 

F  p 

0.01  0.943 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


/ 

\ 

- - 

4.0 

5.0 

6.0 

7.0 
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AS.  ANALYSIS  OP  VARIANCE  ON  the  ■»»■*>*»*•  of  Badger  Aircraft  lost  prior  to 
reaching  their  Neapon  Release  Point  based  on  Four  Infomtion  Levels; 
Both  coBBunities. 


SOURCE 

DF 

SS 

MS 

Level 

3 

3.12 

1.04 

ERROR 

20 

173.83 

8.69 

TOTAL 

23 

176.96 

LEVEL 

N 

MEAN 

STDEV 

0 

6 

5.833 

2.639 

1 

6 

5.667 

2.066 

2 

6 

6.167 

4.708 

3 

6 

5.167 

1.169 

POOLED 

STDEV  * 

2.948 

F  p 

0.12  0.947 


INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


- + - + - + - 

( - * - ) 

( - * - ) 

( - * - ) 

( - * - ) 

- + - + - + - 

4.0  6.0  8.0 


AT.  ANALYSIS  OF  VARIANCE  ON  the  of  Badger  Aircraft  lost  prior  to 

reaching  their  Weapon  Release  Point  based  on  £cbii:  Infomation  Levels; 
TACAIR  COBBUnity. 


SOURCE 

DF 

SS 

MS 

Level 

3 

8.92 

2.97 

ERROR 

8 

61.33 

7.67 

TOTAL 

11 

70.25 

LEVEL 

N 

MEAN 

STDEV 

0 

3 

6.000 

1.000 

1 

3 

7.000 

2.000 

2 

3 

5.333 

5.033 

3 

3 

4.667 

0.577 

POOLED 

STDEV  = 

2.769 

F  p 

0.39  0.765 


INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


- + - + - + - 

( - * - ) 

( - * - ) 

( - * - ) 

( - * - ) 

- + - + - + - 

3.0  6.0  9.0 


AU.  ANALYSIS  OF  VARIANCE  ON  the  Rumbar  of  Badger  Aircraft  lost  prior  to 

reaching  their  Neapon  Release  Point  based  on  EBSIC.  Inforaation  Levels; 
ROM  TACAIR  CoBBunity. 


SOURCE 

DF 

SS 

MS 

Level 

3 

10.7 

3.6 

ERROR 

8 

96.0 

12.0 

TOTAL 

11 

106.7 

LEVEL 

N 

MEAN 

STDEV 

0 

3 

5.667 

4.041 

1 

3 

4.333 

1.155 

2 

3 

7.000 

5.292 

3 

3 

5.667 

1.528 

POOLED 

STDEV  * 

3.464 

F  p 

0.30  0.827 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 


BASED  ON  POOLED  STDEV 

»+ - + - + - + - 

( - * - ) 

( - * - ) 

( - * - ) 

( - * - ) 

_+ - + - + - + - 

0.0  3.5  7.0  10.5 
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AV.  KBAN  OIFFBRBMTIAL  ANALYSIS  OP  the  of  Badger  Aircraft  lost 

iMfore  reaching  their  Weapon  Release  Point. 


riautm  IJ 


AN.  ANALYSIS  OF  VARIANCE  on  the  miahor-  of  Badger  Aircraft  lost  prior  to 
reaching  their  Weapon  Release  Point  based  on  Infomation  Levels; 
Both  cosaunities. 


SOURCE 

DF 

SS 

MS 

F 

P 

War  Spec 

1 

0.04 

0.04 

0. 

01 

0.943 

ERROR 

22 

176,92 

8.04 

TOTAL 

23 

176.96 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 

BASED 

ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

— 

0 

12 

5.750 

2.527 

(  — 

-) 

1 

12 

5.667 

3.114 

( - 

— 

-) 

— 

POOLED  STDEV  * 

2.836 

4.0 

5.0  6.0  7.0 

AX.  ANALYSIS  OF  VARIANCE  on  the  of  Badger  Aircraft  lost  prior  to 

reaching  their  Weapon  Release  Point  based  on  Tuq  Infomation  Levels; 
TACAIR  conninity. 


ANALYSIS 

OF  VARIANCE  ON  BAD 

Lost 

SOURCE 

DF 

SS 

MS 

F 

P 

Level 

1 

6.75 

6.75 

1.06 

0.327 

ERROR 

10 

63.50 

6.35 

TOTAL 

11 

70.25 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


LEVEL  N  MEAN  STDEV  - - + - + - 

0  6  6.500  1.517  ( - * - ) 

1  6  5.000  3.225  ( - * - ) 

POOLED  STDEV  »  2.520  4.0  6.0  8.0 


AY.  ANALYSIS  OF  VARIANCE  on  the  «*»■>»***•  of  Badger  Aircraft  lost  prior  to 
reaching  their  Weapon  Release  Point  based  on  Infonation  Levels; 
worn  tm:air  conunity. 


ANALYSIS  OF  VARIANCE  ON  BAD  Lost 


SOURCE 

DF 

SS 

MS 

Level 

1 

5.3 

5.3 

ERROR 

10 

101.3 

10.1 

TOTAL 

11 

106.7 

LEVEL 

N 

MEAN 

STDEV 

0 

6 

5.000 

2.757 

1 

6 

6.333 

3.559 

POOLED 

STDEV  = 

3.183 

r  P 

0.5j  0.485 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 


BASED  ON  POOLED  STDEV 
- + - + - + - 

( - * - ) 

( - * - ) 

- +— - + - + - 

4.0  6.0  8.0 


AZ.  MEAN  DIFFERENTIAL  ANALYSIS  OF  the  Kumhtir  of  Badger  Aircraft  lost 
before  reaching  their  Weapon  Release  Point.  comninities. 


rlfurm  04 


BA.  ANALYSIS  OF  VARIANCE  (W  the  of  Badger  Aircraft  lost  prior  to 

Weapon  Release  Point  based  on  the  of  CAP  Aircraft  launched; 

Both  conunities. 


SOURCE 

DF 

SS 

MS 

F 

P 

CAP  Lnch 

7 

23.74 

3.39 

0.35 

0.916 

ERROR 

16 

153.22 

9.58 

TOTAL 

23 

176.96 

INDIVIDUAL  95% 

Cl'S  FOR 

MEAN 

BASED  ON 

POOLED  i 

STDEV 

LEVEL 

N 

MEAN 

STDEV 

- +- 

- - — 

— 

-+ - 

8 

4 

5.000 

4.082 

(-- 

— 

- * - 

- _) 

10 

3 

5.667 

4.041 

(- 

— 

- ) 

12 

4 

6.250 

2.217 

(- 

- ) 

14 

5 

7.200 

2.280 

( - 

-* - ) 

16 

2 

6.000 

0.000 

( - 

— 

- ) 

17 

1 

4.000 

0.000 

( - 

— 

- ) 

20 

4 

4.500 

3.416 

( - 

— 

--) 

24 

1 

5.000 

0.000 

( - 

— 

- — *— — 

- +. 

- - 

— 

-+ - 

POOLED  STDEV  = 

3.095 

0.0 

4 

.0 

8.0 

BB.  ANALYSIS  OF  VARIANCE  ON  the  of  CAP  Aircraft  launched  based  on 

Warfare  Specialty;  Both  conaunities. 


ANALYSIS 

OF  VARIANCE  ON  CAP 

Lnch 

SOURCE 

DF 

SS 

MS 

F  p 

War  Spec 

1 

0.0 

0.0 

0. 

00  0.965 

ERROR 

22 

468.6 

21.3 

TOTAL 

23 

468.6 

INDIVIDUAL  95%  Cl'S  FOR 

MEAN 

BASED 

ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

0 

12 

13.917 

4.833 

( - 

-) 

1 

12 

13.833 

4.387 

( - 

-) 

- 

- - 

POOLED  STDEV  = 

4.615 

11 

.2 

12.8  14.4 

16.0 

BC.  ANALYSIS  OF  VARIANCE  ON  the  "•tmhar  of  CAP  Aircraft  launched  based  on 
ZaiC  Inforaation  Levels;  Both  coaaunities. 


ANALYSIS  OF  VARIANCE  ON  CAP  Lnch 


SOURCE 

DF 

SS 

MS 

F 

P 

Level 

3 

78.5 

26.2 

1.34  0.289 

ERROR 

20 

390.2 

19.5 

TOTAL 

23 

468.6 

INDIVIDUAL  95% 

Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

0 

6 

11.000 

3.286 

( - * - 

- ) 

1 

6 

16.000 

4.899 

( - 

2 

6 

14.333 

4.967 

( - 

- ) 

3 

6 

14.167 

4.309 

(— - 

- ) 

POOLED 

STDEV  - 

4.417 

10.5 

14.0 

17.5 

) 
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BD.  ANALYSIS  OF  VARIANCE  ON  the  "itmhttr  of  CAP  Aircraft  launched  based  on 
Four  inforeation  Levels;  tfcair  conunity. 


SOURCE 

DF 

SS 

MS 

Level 

3 

58.9 

19.6 

ERROR 

8 

198.0 

24.7 

TOTAL 

11 

256.9 

LEVEL 

N 

MEAN 

STDEV 

0 

3 

13.333 

3.055 

1 

3 

16.667 

6.429 

2 

3 

10.667 

3.055 

3 

3 

15.000 

6.245 

POOLED 

STDEV  = 

4.975 

F  p 

0.79  0.531 


INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


- + - + - + - +, 

( - * - ) 

( - * - ) 

( - * - ) 

( - * - ) 

- + - + - + - + 


6.0  12.0  18.0  24.0 


BE.  ANALYSIS  OF  VARIANCE  ON  the  of  CAP  Aircraft  launched  based  on 

Four  Information  Levels;  NOW  TACAIR  conunity. 


ANALYSIS 

OF  VARIANCE  ON 

CAP  Lnch 

SOURCE 

DF 

SS 

MS 

F  p 

Level 

3 

139.67 

46.56 

5. 

17  0.028 

ERROR 

8 

72.00 

9.00 

TOTAL 

11 

211.67 

INDIVIDUAL  95%  Cl'S  FOR 

MEAN 

BASED 

ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

. — - 

0 

3 

8.667 

1.155 

- * - ) 

1 

3 

15.333 

4.163 

( - *■ 

- ) 

2 

3 

18.000 

3.464 

(— - 

-) 

3 

3 

13.333 

2.309 

( - * - 

— ) 

POOLED  STDEV  = 

3.000 

5.0 

10.0  15.0 

20.0 

BF.  niimhar  of  Badger  Aircraft  destroyed  before  reaching  Weapon  Release 

Point  based  on  the  Fnmht»r  of  CAP  Aircraft  launched:  Both  conunities. 


8  10  12  14  16  17  20  24 

CAP 


Wifaxm  IS 
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BG.  NBAN  DIPFBREMTIAL  ANALYSIS  OF  the  Humbor  of  CAP  Aircraft  launched 
based  on  foui:  Inforaation  Levels:  Both  cosaunitles. 


Utaa  U 


BH.  ANALYSIS  OF  VARIANCE  on  the  numh^r  of  CAP  Aircraft  launched  based  on 
avo  Inforaation  Levels.  £Q£h  Coaaunities. 


ANALYSIS  OF  VARIANCE  ON  CAP  Lnch 


SOURCE 

DF 

SS 

MS 

Level 

1 

3.4 

3.4 

ERROR 

22 

465.3 

21.1 

TOTAL 

23 

468.6 

LEVEL 

N 

MEAN 

STDEV 

0 

12 

13.500 

4.758 

1 

12 

14.250 

4.434 

POOLED 

STDEV  = 

4.599 

F  P 

0.16  0.693 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 
- + - + - + - 

( - * - ) 

( - * - ) 

- + - + - + - 

12.0  14.0  16.0 


BI.  ANALYSIS  OF  VARIANCE  ON  the  fhtmht*r  of  CAP  Aircraft  launched  based  on 
TMQ.  Inforaation  Levels.  TACAIR  Coaaunity. 


SOURCE 

DF 

SS 

MS 

F 

P 

Level 

1 

14.1 

14.1 

0.58 

0.464 

ERROR 

10 

242.8 

24.3 

TOTAL 

11 

256.9 

INDIVIDUAL 

95%  Cl'S 

FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- +. 

0 

6 

15.000 

4.858 

(”“■ 

- — . 

1 

6 

12.833 

4.997 

( - 

— ) 

- +■ 

POOLED 

STDEV  » 

4.928 

10.5 

14.0 

17.5 
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BJ.  ANALYSIS  OF  VARIANCE  C»l  the  thimbar  of  CAP  Aircraft  launched  based  on 
IKQ.  Inf  creation  Levels.  JWOir  TMCAIR  Conunity. 

SOURCE  DF  SS  MS  F  p 

Level  1  40.3  40.3  2.35  0.156 

ERROR  10  171.3  17.1 

TOTAL  11  211.7 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


LEVEL  N  MEAN  STDEV  - + - + - + - 

0  6  12.000  4.561  ( - * - ) 

1  6  15.667  3.670  ( - * - ) 

POOLED  STDEV  =  4.139  10.5  14.0  17.5 


BK.  MEAN  DIFFERENTIAL  ANALYSIS  ON  the  Number  of  CAP  Aircraft  launched 
based  on  Tmo  Inf creation  Levels:  SQtJt  coeeunities. 


riaurm  U 


BL.  ANALYSIS  OF  VARIANCE  ON  the  mumhar  of  unidentified  air  and  surface 
contacts  identified  based  on  Warfare  Specialty;  Both  coeeunities. 


SOURCE 

War  Spec 

ERROR 

TOTAL 

T  mrvT 

DF 

1 

22 

23 

SS 

0.00 

98.50 

98.50 

MS 

0.00 

4.48 

F  p 

0.00  1.000 

INDIVIDUAL  95%  Cl'S  FOR 
BASED  ON  POOLED  STDEV 

MEAN 

' 

1  o 

ntiAN 

8.750 

siuciV 

2.491 

/ 

U 

x^ 

1 

/ 

X 

x^ 

o  •  /DU 

1 .  oDo 

POOLED  STDEV  = 

2.116 

7.70 

8.40  9 

.10 

9.80 

BM.  ANALYSIS  OF  VARIANCE  (Nl  the  iiii«h<*T»  of  unidentified  air  and  surface 
(xmtacts  identified  based  on  Four  Inforeation  Levels;  Both 
c<»Biunities . 


SOURCE  DF  SS  MS  F  p 

Level  3  19.50  6.50  1.65  0.211 

ERROR  20  79.00  3.95 

TOTAL  23  98.50 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 

LEVEL  N  MEAN  STDEV  - + - + - + - + - 

0  6  8.667  3.011  ( - * - ) 

1  6  10.167  1.169  ( - * - ) 

2  6  7.667  2.066  ( - * - ) 

3  6  8.500  1.049  ( * - ) 

- + - + - + - + - 

POOLED  STDEV  =  1.987  6.4  8.0  9.6  11.2 


BN.  ANALYSIS  OF  VARIANCE  ON  the  of  unidentified  air  and  surface 

contacts  identified  based  on  IVo  Information  Levels;  Both  communities. 


ANALYSIS  OF  VARIANCE  ON  Ctc 

ID  based  on  two 

Information  Levels 

SOURCE 

DF 

SS 

MS 

F 

P 

Level 

1 

10.67 

10.67 

2.67 

0.116 

ERROR 

22 

87.83 

3.99 

TOTAL 

23 

98.50 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 

BASED  ON 

POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- + — — 

0 

12 

9.417 

2.314 

( - * - 

— ) 

1 

12 

8.083 

1.621 

( - 

-* - ) 

- — +«— . 

POOLED 

STDEV  = 

1.998 

7.2 

8.4  9.6 

10.8 

BO.  MEAN  DIFFERENTIAL  ANALYSIS  OF  the  nttmhttr  of  unknown  contacts 

identified:  Four  and  TVo  Information  Levels:  BbUi  communities. 
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BP.  ANALYSIS  OF  VARIANCE  ON  player  Inforaation  Brief  relevance.  Both 
conninities . 


SOURCE 

DF 

SS 

MS 

F 

P 

FACTOR 

5 

238.00 

47.60 

40.80 

0.000 

ERROR 

126 

147.00 

1.17 

TOTAL 

131 

385.00 

INDIVIDUAL  95%  Cl'S  FOR  MEAN 
BASED  ON  POOLED  STDEV 


LEVEL 

N 

MEAN 

STDEV 

Aircraft 

22 

2.182 

0.958 

( - * - ) 

SAM 

22 

2.364 

1.255 

( - *— ) 

Logistic 

22 

5.364 

0.658 

( - *— ) 

OP  Comm 

22 

5.000 

0.756 

( - *— ) 

Air  Surv 

22 

2.136 

1.037 

( - * - ) 

DefStrat 

22 

3.955 

1.558 

( - * - 

) 

POOLED  STDEV  = 

1.080 

2.4 

3.6 

4.8  6 

BQ.  ANALYSIS  OF  VARIANCE  ON  player  Inforaation  Brief  relevance.  TACAIR 
conunity. 


SOURCE 

DF 

SS 

MS 

F 

P 

FACTOR 

5 

148.167 

29.633 

31.63  0. 

000 

ERROR 

66 

61.833 

0.937 

TOTAL 

71 

210.000 

INDIVIDUAL  95%  Cl'S  FOR 

MEAN 

BASED  ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

-+ - +- 

TA  a/C 

12 

2.4167 

0.7930 

( - * - ) 

TA  SAM 

12 

1.9167 

0.9962 

( - *— ) 

TA  LOG 

12 

5.5000 

0.7977 

( - *  — ) 

TA  COMM 

12 

5.1667 

0.5774 

(-“* - ) 

TA  SURF 

12 

2.1667 

1.1146 

(--* - ) 

TA  STRAT 

12 

3.8333 

1.3371 

( - *— ) 

_+ - +- 

- + - 

POOLED  STDEV  = 

0.9679 

1.5  3.0 

4.5 

6.0 

BR.  ANALYSIS  OF  VARIANCE  ON  player  Infomation  Brief  relevance.  JIQfi  TAP 
AIR  conunity. 


SOURCE 

DF 

SS 

MS 

F 

P 

FACTOR 

5 

98.20 

19.64 

13. 

81 

0.000 

ERROR 

54 

76.80 

1.42 

TOTAL 

59 

175.00 

INDIVIDUAL 

95% 

Cl'S  FOR  MEAN 

BASED 

ON  POOLED  STDEV 

LEVEL 

N 

MEAN 

STDEV 

- +_ 

— 

- +. 

+■ 

— 

- +. 

NTA  a/c 

10 

1.900 

1.101 

( - 

- 

-) 

NTA  SAM 

10 

2.900 

1.370 

( - 

— 

- ) 

NTA  LOG 

10 

5.200 

0.422 

(■ 

- *• 

- ) 

NTA  COMM 

10 

4.800 

0.919 

(-- 

— 

•) 

NTA  SURV 

10 

2.100 

0.994 

(  — 

-) 

NTA  STRA 

10 

4.100 

1.853 

( - *— 

-) 

- +_ 

- +. 

- +. 

POOLED  STDEV  = 

1.193 

1.5 

3.0 

4. 

5 

6.0 

155 


LIST  OF  REFERENCES 


ALPHATECH  Corporation,  Fundamental  Precept  of  Command  and 
Control,  26  January  1994. 

C4  Architecture  &  Integration  Division  (J6I),  The  Joint 
Staff,  C-I  For  The  h^arrior.  Government  Printing  Office, 
Washington  O.C.,  12  June  1993. 

Hartman,  J.K. ,  Parry,  S.H.,  Caldwell,  W. J. ,  Aggregated  Combat 
Modeling.  7  December  1992,  Unpublished. 

Hughes,  W.P.,  and  others.  Military  Modeling.  Military 
Operations  Research  Society,  Inc.,  1984. 

O'Keefe,  S.,  Kelso,  F.B.,  Miindy,  C.E.,  From  The  Sea .  September 
1992. 

Thomas,  C.,  HOES  —  Origins,  Evolution,  Roles,  1985, 
Unpublished. 

Van  Creveld,  M.,  Command  In  War,  Harvard  University  Press, 
1985. 


156 


INITIAL  DISTRIBUTION  LIST 


1.  Defense  Technical  Information  Center  2 

Cameron  Station 

Alexandria,  Virginia  22304-6145 

2.  Library,  Code  52  2 

Naval  Postgraduate  School 

Monterey,  California  93943-5002 

3.  Professor  Samual  Parry,  Code  OR/Py  3 

Naval  Postgraduate  School 

Monterey,  California  93943 

4.  Professor  Daniel  Boger,  Code  SM/Bo  3 

Naval  Postgraduate  School 

Monterey,  California  93943 

5.  Professor  Carl  Jones,  Code  SM/Js  1 

Naval  Postgraduate  School 

Monterey,  California  93943 

6.  LT  David  Adams  1 

1916  Baumgartner  Ave. 

Nindber,  Pennsylvania  15963 

7.  LT  Hugh  Glass  1 

2115  Rockport  Road 

Janesville,  Wisconsin  53545 


157 


